System for and a method of playing interleaved presentation segments

ABSTRACT

A method of, and a system capable of, playing at least a portion of at least one presentation segment, such as a camera angle segment, from a set of interleaved presentation segments included within a video, the method comprising the steps of, and the system comprising preferencing, processing, random accessing, and buffering means for, responsive to segment information, a preestablished content preference including a presentation preference and a preference for a duration of a portion of a presentation segment, sequentially and seamlessly playing a portion, at least a portion, and/or the substantial entirety of a presentation segment from said set of interleaved presentation segments; receiving, during said playing of a presentation segment, a change in said presentation preference; successively playing in a randomized looped fashion, responsive to said segment information and said change in said presentation preference, at least a portion, a portion, and/or the substantial entirety of another presentation segment from said set of interleaved presentation segments; and wherein a playing of at least one portion of a presentation segment is skipped in response to the preestablished content preference.

This is a division of application Ser. No. 09/190,773, filed Nov. 12,1998.

BACKGROUND OF THE INVENTION

1. Field of the Invention

Systems for, and a methods of, processing, random accessing, buffering,and playing a video utilizing the information provided by a video map,where the source of the video and video map are, for example, a DVD, aDBS, and/or video-on-demand transmission, and where the means forplaying the video comprises, for example, a DVD player, a personalcomputer, a set box, and/or a multimedia player.

2. Description of the Related Art

A DVD (Digital Video Disc/Disk or Digital Versatile Disk) is a randomaccess optical disc similar in physical dimensions to a CD withsubstantially more data storage capacity. A DVD can store one fulllength motion picture in one of two layers on either side of the disc.Many DVDs include subtitles and/or closed captioning in a plurality oflanguages for a motion picture stored in a DVD, multiple camera anglesfor a scene, and the capability to play one of a plurality of differentcontent versions (e.g. a director's cut or unrated version and an “R”rated versions.

Devices capable of playing DVDs provide for, among other features,capabilities for fast-forward, fast rewind,, skip-forward to thebeginning of the next chapter, and to skip-backwards to the beginning ofthe current chapter and a previous chapter, the option to turn on/offthe subtitles, and if turned on, to select the language of the subtitle,select language of the audio, cameral angles, and multiple contentversions.

While the DVD format provides many capabilities and functions exceedingthose provided by, for example, the VHS format, as a result of conceptsrooted in the conventional linearity of motion pictures, many of thecapabilities and functions specified do not fully realize the potentialof a randomly accessible digital video, audio, and data format.

SUMMARY OF THE INVENTIONS

By contrast to the passive playing of videos, as in the viewing of amotion picture, or the interactive playing of a video, as in the playingof a computer game, a primary element of the “autoactive” systems andmethodologies disclosed herein is the incorporation of capabilities andenvironments that automatically customize the playing of videos tosatisfy the particular video requirement of each of a plurality ofviewers, and that deliver to each viewer a more enjoyable videoexperience without requiring the level of active participation inherentin interactive systems, the use of personal computers, and/or byprimitive consumer electronic products.

Accordingly, it is an object to provide a multimedia multisourcereceiver transmitter player comprising random access and communicationscapabilities integrating video and communication services.

It is also an object to provide a remote control device with thefunctionality required to control a multimedia multisource receivertransmitter player comprising random access and communicationscapabilities integrating video and communication services.

It is also an object to provide for a labeling of keys consistent withthe functionality required to control a multimedia multisource receivertransmitter player comprising random access and communicationscapabilities integrating video and communication services.

It is also an object to provide for the automated selective retrieval ofnon-sequentially stored, parallel, transitional, and overlapping videosegments from a single variable content video source, responsive to theviewer's video content preferences, and transmits the selected segmentsas a logical, seamless, and continuous version of the video.

It is also an object to play a version of a video that is highlyresponsive to a viewer's content preferences, by automatically selectingamong parallel, transitional, and overlapping segments included, withinthe video.

It is also an object to provide content control over, for example, avideo's level explicitness, detail, expertise, form of expression,subject matter, element development, and program length.

It is also an object to provide an interactive video game systemcomprising interactive video game software, variable content game, and avideo map defining segments of the variable content game, furnishing aplayer of the interactive video game the automatic and logical selectionof video segments responsive to the application of the player's videocontent preferences to the video map, and responsive to the logic of theinteractive video game software.

It is also an object to provide viewers the means of accessing availablevideos, segments from a video, and or segments from a plurality ofvideos by the use of keyword or a classification tree structure as wouldbe required by a user accessing a very large database of segments andvideos.

It is also an object to provide the means for a viewer to detail thesubject matter, story line, and or general content of a desired video sothat producers of videos may elect to produce and provide the requestedvideo.

It is also an object to provide a variety of reading architectures thatproduce a seamless reading of sequential and non-sequential segments ofa variable content video from a single video source.

It is also an object to format the video stream, through placementand/or duplication of frames, group of frames, and/or segments toenhance the seamless playing of non-sequential segments.

It is also an object to provide for the playing of multiple playsegments of a variable content video.

It is also an object to provide a device that furnishes a previewer,such a parent, the capability for efficiently previewing automaticallyselected segments from the video, responsive to the establishedpreferences of a viewer, such as a child, to permit the previewer toindicate the inclusion of the selected segments in the video to beviewed by the viewer.

It is also an object to provide automated capabilities for efficientlyretrieving and playing only a specified class, category, or subjectmatter included in segments within the selected video or set of videosas may be available from a database of videos.

It is also an object to integrate communications capabilities andread/write optical disc player capabilities within a single device tofacilitate the downloading of a motion picture from a source remote tothe player.

It is also an object to provide the means for a viewer to transportvideo and content preferences to enable autoconfiguring a player.

It is an object to enhance the viewing of a video by providing anelegant means and method for replaying for a viewer a non-understoodsegment of a video.

It is an object to utilize a video's foreground and background audioelements to provide audio during a video pause.

It is an object to provide for a plurality of fast-forward variableintermittent content skipping methods.

It is an object to provide for an automatic display of a viewer definedtarget within a video as the target moves relative to the video's hostimage.

It is an object to provide for a plurality of methods of playingpresentation segments of a set of presentation segments of a scene.

It is an object to provide for the integration of a playing of a videowith the acceptance of a communication.

Briefly, these and other objects are accomplished by autoactivecapabilities and functions provided by systems comprising, andmethodologies utilizing, integrated processing, random accessing, andbuffering technologies, variable content video structures andconfigurations, control capabilities, software functions, and videoinformation, such as information that describes, defines, links, and/orcombines segments of a video and/or videos, with respect to a pluralityof content, technical, and presentation categories, and playingfunctions, that facilitate the manipulation of the playing of a video,or a plurality of videos, to satisfy a wide range of content, technical,and presentation preferences. Autoactive capabilities and function beingprovided, whether the source of the video is, for example, a DVD, a DBS,and/or a video-on-demand transmission, and whether the means for playingthe video comprises, for example, a DVD player, a personal computer, aset box, and/or a multimedia player.

These and other features, advantages, and objects, are apparent in thecontext of the detailed description, accompanying drawings, and appendedclaims, that follow.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a multimedia multisource receivertransmitter player comprising random access and communicationscapabilities;

FIG. 2 is an illustration of a remote control device;

FIG. 3 is an illustration of a labeling of function keys;

FIG. 4 is a diagram of a video and communications integrated network;

FIG. 5A is a flow chart summarizing the steps of producing a variablecontent video;

FIGS. 5B, 5C, 5D, and 5E, are illustrations of segment descriptivestructures;

FIGS. 6A, 6B, and 6C, are diagrams of three versions of a video andcorresponding content codes;

FIG. 6D is a diagram illustrating the resulting sequential andnon-sequential arrangement of video segments within a variable contentvideo;

FIG. 6E is an illustration of an editing screen in a variable contentvideo nonlinear editing system;

FIGS. 7A-7G are examples of content preference selection screens andscreens utilized in the selection of videos;

FIG. 8A is a schematic of a video disc player's multiple reading unitsarchitecture;

FIG. 8B is a diagram representation of a video reading stream andtransmission stream;

FIG. 9A is a flow chart detailing the steps of playing a variablecontent video;

FIG. 9B is a flow chart detailing the steps in the playing of multipleplay segments of a variable content video;

FIG. 10 is a flow chart detailing the steps of previewing flaggedsegments;

FIG. 11 is a flow chart detailing the steps of retrieving a variablecontent video from a video services provider;

FIG. 12 is a flow chart of a method of replaying a segment of a videowith supplementary information;

FIG. 13 is an illustration of the utilization of foreground andbackground audio to provide audio during a video pause;

FIGS. 14A, 14B, and 14C, illustrate a plurality of fast-forward variableintermittent skipping methods;

FIG. 15 illustrates the automatic display of a viewer defined target asthe target moves relative to the host image;

FIG. 16 is a flow chart detailing the steps of creating a viewer definedwindow;

FIGS. 17A through 17H illustrate a plurality of methods of playing a setof presentation segments;

FIG. 17I illustrates an example of a fragmenting and looping of aplaying of at least one segment of a video.

FIG. 18 is a flow chart detailing the steps of integrating the playingof a video with the acceptance of a communication.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following are incorporated herein by reference: i)subject-matter-related U.S. Pat. Nos. 5,434,678, 5,589,945, 5,610,643,5,634,849, 5,664,046, 5,684,918, 5,696,869, 5,717,814, and 5,724,472, bythe same inventor; ii) U.S. Pat. Nos. 5,636,200, 5,630,006, 5,778,142,5,745,643, 5,598,276, 5,644,507, 5,737,479, 5,778,135, and 5,678,012;and iii) the RCA DVD player RC5200P user's manual, 1996.

For purposes of the present disclosure, various terms used in the artare defined as follows:

The term “viewer” as used herein is meant to include and beinterchangeable with the words “player” (when referring to a person),“subscriber”, and “user”. That is, the term “viewer” is to be understoodin the general sense of a person passively viewing a video,interactively playing a video game, retrieving video from a videoprovider, and/or actively using multimedia, internet, and/orcommunication services.

The terms “video”, and “video program” are interchangeable and refer toany video image regardless of the source, motion, or technologyimplemented. A video comprises still characters, graphics, images,motion pictures, films, interactive electronic games, and multimediaproductions; full motion pictures and television programming; news,sports, cultural, entertainment, commercial, advertisements,instructional, and educational programming. A video comprises video,audio, subpicture information, data and other information associatedwith the video. Unless otherwise qualified to mean a computer softwareprogram, the term “program” is interchangeable and may be replaced withthe word video. While a particular feature may be detailed with respectto a specified viewing, gaming, or computing application, it is intendedto apply the teachings herein broadly and harmoniously across thedifferent classes of applications that generate a video. The teachingsherein with respect to a video applied to, for example, movies, news,sports, educational videos, advertisements, informationals, commercials,and other videos for the promotion of products and services.

A video also comprises a “variable content video” and a “variablecontent game”, which are characterized by a nonlinear architecturefacilitating a variety of possible logical sequences of segments. Avideo herein comprises a video map and video/audio/subpictureinformation including parallel, transitional, and overlapping segmentsto provide viewing of a program's story-line/interactive action atdifferent levels of forms of expression, levels of detail, and, forexample, length, with a greater seamless continuity among non-sequentialsegments. Additionally a video may include a user interface, softwareprogram routines, and system control codes for controlling the playingof the video. The term “segment” refers to a part of the video whetherone or a plurality of frames.

The terms “non-sequential” and “nonlinear” are intended in the sensethat the video includes within a segment (e.g. an “R” rated segment)presenting a scene in a manner which would normally exclude the playingof another segment (e.g. a “PG” rated segment) with a differentpresentation (e.g. version) for the same scene. In a physical sense, thesegments are “linearly” arranged and one would follow the other, whetherimmediately or after one or a plurality of other frames and/or segments.

The term “seamless” is intended in the sense that the transmission ofsequential and non-sequential frames is indiscernible to the eye, andnot in the sense of the natural video seams that result in the intendedchanges from one scene to another, from one camera angle to the other,or from one gaming sequence to the other.

The term “content preferences” refers, specifically and principally,although not exclusively, to a viewer's preferences for the form ofexpression, explicitness, the absence of objectionable segments, contentcategories and levels, length, and detail. The set of contentpreferences also include “technical preferences” and “presentationpreferences” as herein identified. In the broadest sense, the term“content preferences” further comprises video, programming, and subjectmatter preferences (“programming preferences”). Programming preferencesrefer exclusively to a viewer's preferences as to specific videos (e.g.Sega's “Sherlock Holmes Consulting Detective”), types of videos (e.g.interactive video detective games), broad subject matter of videos (e.g.mysteries), and/or time and date that the viewer may desire to view avideo. Programming preferences are principally directed at the selectionof a specific video.

The term “video-on-demand system” refers to any pointcast capable videodelivery system that is responsive to a viewer's programmingpreferences, i.e. provides a viewer-selected video at a viewer-selectedtime. Video-on-demand comprises for example movies-on-demand, videodialtone, cellular video, and digital satellite systems that areresponsive to a viewer's time and date preferences and that usuallyprovide VCR functionality in the viewing of a video.

The term “content-on-demand system” refers to a video-on-demand systemthat is additionally responsive to a viewer's content preferences. Acontent-on-demand system not only permits a viewer to obtain a specificprogram(s) or segment(s) of programs in response to the viewer'sprogramming preferences, a content-on-demand system also permits theviewer to receive a customized version of the program(s) or segment(s)of programs that are responsive to the viewer's content preferences. Acontent-on-demand system and the delivery of variable content videoservices is independent of the specific hardware and networkinfrastructure employed.

The term “network” herein refers to any private or public, wired andnon-wired video transmission infrastructure, such as may be provided bythe utilization of one or a hybrid combination of the following: fiberoptic, coaxial cable, twisted copper wire, cellular, radio, satellite,and/or other existing and/or forthcoming video transmissiontechnologies. Examples, include a Broadband Integrated Services DigitalNetwork (“B-ISDN”) utilizing fiber optic cable in its primary trunks, aDigital Subscriber Line that promises high bandwidth over twistedcopper-pair phone lines, and the internet. In the broadest sense, anetwork also comprises the utilization of, for example, the U.S. PostalService to deliver DVDs.

Where not clearly and unambiguously inconsistent with the specificcontext, these and other terms defined herein are to be understood inthe broadest sense.

Preferred embodiments of the various inventive elements disclosed hereinutilize a multimedia multisource receiver transmitter player(“Multimedia Player”) comprising synergistically integrated randomaccess and communications capabilities. The Multimedia Player comprisesthe various functions, capabilities and components of a variety ofconsumer electronic systems including, for example, a DVD player (e.g.Pioneer's DVL-909 DVD/LD Player), a game system (e.g. Nintendo 64 videogame system), a net surfboard (e.g. Philips Magnavox Internet TVTerminal), a Direct Broadcast Satellite (“DBS”) receiver (e.g. Sony'sSAS-AD3 Digital Satellite System), a multimedia computing device (e.g.Gateway's Destination Digital Media Computer); a nonlinear editingsystem (e.g. Avid' Media Composer 9000); and a set-top box capable ofretrieving video-on-demand services from a remote video servicesprovider (e.g. Scientific-Atlanta's Explorer 2000 digital set-top)

A Multimedia Player permits a viewer to obtain videos, multimedia, andother services from storage means within the Multimedia Player, sourceslocally accessible, and/or from a remote services provider.Additionally, the Multimedia Player, as per the various inventionsdetailed herein, comprises the means and operational methods of, forexample, i) customizing a playing of a motion picture stored in a DVD;ii) time shifting and customizing the playing of a motion pictureobtained from, for example, a DBS transmission; iii) playing real-timeaudio during a slow-motion and freezing of a motion picture; iv)automatically tracking the subject of a video zoom; v) integratingcommunications (e.g. phone answering) with a playing (e.g. auto-replay)of a motion picture; and vi) autoconfiguring a host Multimedia Player.

FIG. 1 is a schematic diagram of a fully featured Multimedia Player 100comprising the following primary modules and subsystems: i) randomaccess video/data disc module (e.g. a multi-disc DVD read/write drive)101; ii) communications module 102; iii) fixed storage subsystem 103;iv) removable storage subsystem 104; v) compact portable storagesubsystem 105; vi) external video/audio input/output support module 106;vii) multi-user modules 107; and viii) multi-services modules 108.

The communications module 102 may be as simple as a modem card ordevice, or as sophisticated as may be required by a direct fiber opticaccess to a remote video and communication services provider. Thecommunications module may support a plurality and variety of cablingconnections such as fiber optic cable, coaxial cable, and twisted paircopper wire, and the cabling required to access a variety of networks.Additionally, the communications module may support a plurality ofcompeting broadcasts and pointcast video delivery systems. In thisfashion by merely depressing the appropriate keys in a remote controldevice a viewer can easily switch between off the air transmissions andon-line services. By this method a video services provider can satisfy awide range of video requirements without necessarily utilizingvideo-on-demand system capacity. In such instances a Multimedia Playermay be connected to a local receiving means. The receiving means may be,for a example, an indoor antenna, an outdoor antenna, or an existingsystem, such as the electrical system, that may serve as an antenna.

The fixed memory subsystem 103 refers to any nonvolatile memory storagedevice principally utilized to randomly read/write and store significantquantities of information. An example of a fixed memory storagesubsystem is a personal computer's hard disk drive.

The removable memory subsystem 104 refers to any nonvolatile memorystorage device principally utilized to transport information to and fromtwo similarly equipped devices. Examples of removable memory storagesubsystems are personal computer floppy disk drives, micro disk drives,backup tape drives, and removable hard disks. The random access discmodule 101 is another example of a removable storage subsystem.

The compact portable storage subsystem 105 and user access media 144 isprincipally distinguished from a removable storage subsystem 104 by thesize of the media and the greater variety of memory storage technologiesthat are generally implemented. Nonetheless, some of the removablestorage media, such as for example a micro disk, are also considereduser access media 144. With present technology, user access media isavailable in dimensions similar to conventional credit cards. Examplesof other removable storage media and user access media are: laserread/write cards, in which at least one surface of the card permits alaser to read/write information; electronic cards, in which theinformation is stored in electronic components; magnetic cards embodyingmagnetic storage technology, of which a credit card is an example,electronic cartridges commonly utilized in electronic video gamesystems, smart cards, and PCMCIA cards.

Clearly, a variety of memory devices are available utilizingtechnologies and combinations of technologies to suit particularperformance requirements. The above classifications of the memorydevices are directed at bringing attention to functional capabilities ofa Multimedia Player rather than to a particular technology. Theclassifications are not intended to restrict a subsystem to a particularclassification, limit the selection of subsystems which may beimplemented, or to limit the function of the particular subsystemimplemented.

It is intended that a full featured Multimedia Player additionally“play” a variety of laser readable media, such as, DVDs, laser discs,CDs, photo CDs, and interactive videos and games, in a conventionalmanner. The wide range of vidoe/data discs that may be accommodated andthe various configurations are diagrammatically emphasized in FIG. 1 asthe five stacked circles and the five circles inside the representationof the video/data disc unit 101.

The external video/audio input/output support module 106 supportsvideo/audio/data transmission to the primary video display systemcomprising, for example, a monitor/television, stereo system, andkeyboard/voice recognition-response. Additionally, the input/outputmodule supports video/audio input from local sources such as for exampleVCR's, video cameras, and videophones. The construction of the externalsupport module follows the conventional practices of consumer electronicproducts as for example: DVD players, VCRs, and personal computers.

Multi-user modules 107 principally support separate controlledindependent access by other users of the Multimedia Player's processing,video, and communications resources. The construction of multi-usermodules following established networking technologies.

In a preferred embodiment, instead of utilizing one of the Windows orUnix operating systems, the Multimedia Player will incorporate a smallfootprint multi-user multitasking real-time operating system with astreamlined user interface patterned after, for example, the simplerinterface of a DBS receiver. A multi-layer approach to thefunctionality/complexity of such functions as surfing the net; contactmanagement and email, DVD/Internet hybrid games, applications andservices; video editing; multimedia and word processing; and portfoliomanagement and banking, are made available at a streamlined level thatprovides functionality required by most users at a markedly reducedlevel of complexity. The interface of the cited Web TV is an example.

Multi-services modules 108 provide a host of services, such as forexample residential security, and appliance operation management. Theoperation of the module being principally a software application runningunder the multi-user operating system implemented. The construction ofthe particular multi-service module being responsive to the particularapplication.

The Multimedia Player further comprises computing elements and videoprocessing elements readily found in multimedia devices and videoelectronic systems such as, for example, and not limitation,microprocessor 111, memory units 112, video processor or digital signalprocessor (e.g. Chromatic Research's Mpact 2 media processor) 113,video, audio, and data buffers 114, and nonvolatile memory 115.

The video audio module or board 106 and the video processor 113 comprisecompression-decompression technologies to both retrieve and decompressvideos and compress and transmit videos. The compression technologiesmay include hardware, firmware, software, or any combination of these.One or a plurality of existing and forthcoming video compression methodsmay be implemented such as: Motion-JPEG, MPEG 1, MPEG 2, Fractals, andWavelets. It should be appreciated that as more media becomes availablein a digitally compressed format from a variety of sources, for example,DBS, DVD, digital camcorders, resident compression capability becomesless necessary.

A Multimedia Player's control programs that manage the MultimediaPlayer's resources, and the retrieval and processing of data and videoinformation, reside in dedicated chips 121. Alternatively, oradditionally, control programs are stored in mass memory devices 103from installed or downloaded software, in removable memory media 104, orin an user access media 144.

A Multimedia Player's user control interface 131 includes communicationsto the buttons and keys located on the cabinet of the device, and to theassociated control devices 141-142-143. The keys, buttons, and switches,conventionally found in consumer electronic systems and deemedadvantageous to the operation of the Multimedia Player may also beimplemented. These controls are further augmented by a plurality offunction comprising: segment skipping control, magnification controls,content preferences control, video map control, and system menu control.The user control interface 131 additionally supports infrared and/or RFremote control units 141 (e.g. numeric control pad, and keyboard with atouchpad); wire connected control units 142 (e.g. cable connectedcomputer keyboard, mouse, and game controller); and a voice recognitionunit 143.

The keyboard, similar to a personal computer implementation, facilitatessystem setup, keyword retrieval, and system functions requiring theentry of alpha characters. Since a preferred configuration of aMultimedia Player comprises significant multimedia capabilities, akeyboard pointing means is advantageous. A keyboard connector used toconnect a standard AT keyboard or a dedicated keyboard is supplied.Alternatively, an infrared-based or radio-based keyboard is implemented.Further, given the computing and storage capabilities of MultimediaPlayer, a voice response subsystem option accommodating at least the fewcommands, such as play, stop, mute, audio, skip, required to control thebasic operations can additionally be provided. The sophistication of thevoice recognition capability can be enhanced as the hardware/softwareconfiguration of the Multimedia Player advances within mass market pricepoints.

Implemented in the Multimedia Player is a digital system status displaysubsystem 132, which provides visual feedback and system statusinformation similar to the implementations in VCR and DVD devices.

In general, parts, subassemblies, and components of a Multimedia Playerare of conventional characteristics and are freely substituted by likefunctioning elements and components. For example, and not limitation,while fiber optic-based communications are preferred, copper phone linesand coaxial cable-based communications are considered, albeit lesscapable, nonetheless, functional equivalents. Additionally, a certaindegree of redundancy of components is illustrated in FIG. 1 toschematically show and detail significant functions.

Clearly, redundant components in general, and redundant electroniccomponents in particular, are intended to be eliminated in a preferredembodiment. For example, while a Multimedia Player may include aremovable memory subsystem and a compact memory subsystem, one is thefunctional equivalent of the other and one or the other may beeliminated. In general, where cost effective, components and electronicsare designed to serve a combination of functions.

Further, the configuration of the Multimedia Player's various modules,components, and subsystems, are intended to offer flexibility analogousto that found in a personal computer. Specifically with respect to themulti-user capabilities, a Multimedia Player may be configured, forexample, with more than one DVD module, whether inside the primarycabinet or in a mating or sister cabinet. Various embodiments ofMultimedia Players do not include all, or even most, of the means,and/or capabilities detailed herein. The particular configuration of aMultimedia Player is responsive to the particular function or functionsdesired.

Responsive to user friendliness, a more advanced wireless plug and playcommunications and power motherboard and cabinet design is preferred.The motherboard and cabinet permitting the replacement of, for example,the power supply 109 just as easily as a battery is replaced in aportable personal computer. In a preferred embodiment of a MultimediaPlayer, every component and subsystem is added or replaced withoutresorting to screwdrivers and the need to unplug and plug communicationsand power cables.

A remote control device as per the teachings herein may be based on anynumber of technologies both wired and non-wired. FIG. 2 is anillustration of a remote control device 200 that, for example,comprises: optical power panels 201; a display screen 202 thatadditionally responsibly labels 203 interactively defined function keysi-v 212; speaker 204; microphone 205; multimedia source selection/on-offkeys (e.g. Broadcast TV, DVD, DVS, WEB, and other sources SRC) 211;menu, help, and selections control keys 221; telephonic alphanumeric keypad 231; gaming controls 241-242; screen position and menu controls 251;channel controls (Last Channel, Up Channel, Down Channel) 261; volumecontrols (Mute. Lower, Higher) 262; edit controls keys 271; and videocontrol keys (e.g. Pause/Play) 281.

The interactively defined and labeled function keys i-v 212 permits areduced set of function keys to provide access to individual sets ofmultiple functions for each of a plurality of viewers, as is suggestedby the labels 203. The function keys 212 also provide, for example,subject category selection, program selection, content preferenceselection, and source selection 219. Pressing one of the i-v keys 212results in an appropriate new menu of labels and/or icons to bedisplayed 203.

In particular the interactively defined and labeled function keys may beautomatically configured and reconfigured by a specific videotransmission or other information downloaded from, for example, theMultimedia Player. For example, when a specific viewer accesses theremote control, the display may show blinking icons for voicemail andemail received for that individual.

The SFWD and SREV keys in the video control key set 281, in particularprovide a viewer access to the functions that utilize the capabilitiesthat are made possible by a video's segment information. During theviewing of a video, pressing the SFWD key causes the termination of theplaying of the current segment, and the seamless playing of the nextlogical segment defined by the segment information. For example, duringthe viewing of a panel discussion, a viewer may for a variety of reasonsprefer to exclude a panelist from the program. This the viewer caneffectively do with the skip functions. Advanced skip functions automatethe skipping of every instance of the appearance of that panelist in theprogram. That is each time the panelist begins to speak, the panelistgets skipped. A SREV key replays the current segment or the immediatelyended segment.

It is noted that segment information for the skip and replay functionsneed not be congruent with, and may supplement, other segmentinformation (e.g. definitions) detailed further below.

The edit controls keys 271 permit flagging a segment during the viewingof the video. The segment exclude key permits automatically excludingthe current scene/segment the next time the program is viewed. Thesegment include key is utilized for example, by a parent to indicatethat a possibly objectionable segment may be included in the programprovided a child.

The MARK key 272 permits the viewer to define a segment. The first timethe MARK key is pressed, it identifies the beginning frame. The secondtime the MARK key is pressed, it identifies the end frame. The segmentinclude and segment exclude editing keys would then be utilized to codethe viewer defined segment. Additionally, interactively defined andlabeled function keys; menu, help, and selections control keys; andalphanumeric key pad; can provide access to segment coding functions.

Keys may be labeled, and other keys found in the art may be addedresponsive to the particular requirements of the functions implemented.For example, shuttle controls may be provided alternatively to, or inaddition to, the gaming control shown which can serve the functionsprovided by the shuttle controls. Other examples are suggested by theremote controls provided with the RCA's RC5200P DVD player, and theMitsubishi's HS-U580 VCR.

Further, the capabilities, functions, keys and other elements of aremote control device may be synergistically integrated with a remotekeyboard with integrated touch pad and/or pointing device. In suchembodiments, the function keys or dedicated keys, for example, may beconfigured to provide direct access to the various functions.

FIG. 3 is an illustration of the function key labeling which may bedisplayed on a monitor, on a keyboard strip, displayed on the keyboard,or printed on the keyboard. For purposes of illustration the functionskeys are arranged in FIG. 3 in a cascading manner. Clearly, aconventional horizontal linear layout or a variety of other layoutsresponsive to the particular keys utilized may be implemented. Keylabeling 301 may comprise, for example, a function label 302, e.g. Fast,function icon 303, and key identifier (e.g. F4) 304. Where the keys aredisplayed on a monitor or other display means, the key labeling may beresponsive to a pointing device's cursor position.

Further, the remote control device detailed with respect to FIG. 2comprises all of the components and elements, e.g. a DSP andelectronics, required to serve as a standalone portable phone forconventional phone communications, and/or as a phone communicationscapable remote control device synergistically integrated with thecapabilities of the Multimedia Player. The utilization of a phonecommunications capable remote control device is advantageous in, forexample, the integration of the playing of a video with the acceptanceof a communication, as detailed with respect to the flow chart of FIG.18.

A variable content video, segment information, play routines specific tothe video, and control codes for automatically configuring orcontrolling the functions of the Multimedia Player may be provided bymeans of a variety of existing and evolving technologies. In addition tothe hard formats such as tape, DVD, optical/magnetic disk, memory chipsand modules (e.g. RAM, DRAM, high capacity flash memory, bubble memory);a video may be provided by soft formats such as may be implemented in avariety of communications networks utilizing for example analog ordigital cable transmissions, fiber optic transmission, phone andsatellite communications. A Multimedia Player need not be physicallyaccessible by a viewer nor physically located near the television set.The Multimedia Player may provide a viewer access to remote videoresources and may itself be remotely controlled by the viewer. Fiberoptic and coaxial communications easily permit the required transferrates over long distances between controllers, Multimedia Players, andother video sources.

It is within a network-based implementation, that the various advantagesand capabilities of variable content video services are realized. Withrespect to the specific hardware technologies and architectures of anunderlying video delivery system, the following U.S. patents,incorporated herein by reference, detail a variety of programtransmission technologies embodying varying degrees of capabilities:U.S. Pat. Nos. 5,815,194; 5,815,146; 5,793,411; 5,790,174; 5,247,347;5,133,079; 5,130,792; 4,995,078; 4,891,694; and 4,506,387.

FIG. 4 is a schematic diagram of a video provider and end user networkarchitecture in which participants in the network 400 comprise anynumber of video providers 411-413, and any number of end users 431-436.Participants in the network 900, however, whether classified as videoproviders 411-413 or end users 431-436 are both providers and end usersof video services. Analogous to a communications network, eachparticipant is able to retrieve and transmit video/data from any otherparticipant. An example of an embodiment is the “video dialtone” modeladvanced by the Federal Communications Commission.

A video-on-demand system, in general, a content-on-demand system, andthe delivery of variable content video services, in particular, areherein intended to be deployable by a variety of possible networks andMultimedia Player configurations. FIG. 4 suggests a plurality of networkinfrastructures that may be implemented. Shown are wired and non-wiredvideo transmission infrastructures based on the use of one or a hybridcombination of the following: fiber optic 401, coaxial cable 402,twisted copper wire 403, microwave and radio 404, and satellite 405.

Each participant in the network obtains a hardware configurationconsistent with their desire and objectives, and their financialresources. The video system of a participant who wishes to serve as avideo provider 411-413 is functionally equivalent to the MultimediaPlayer device previously detailed with respect to FIG. 1, differing onlyin that the respective resources are appropriately scaled and modifiedto simultaneously access a variety of videos, and service a number ofend users. Both an end user's Multimedia Player 431 and a nonlinearediting system 471 are in fact video servers. A video server of a videoservices provider is distinguished principally by the significantlygreater video storage capacity and the number of video streams it canservice.

A video provider system, for example 411, comprises: i) communicationstechnologies 421 for establishing a plurality of video andcommunications streams to a plurality of Multimedia Players 431-436; ii)processing hardware and software 422 for retrieving from a MultimediaPlayer an end user's video preferences and content preferences, and forautomatically selecting, for each of the participating end users, avariable content video responsive to the video and content preferences;iii) mass storage random access memory devices 423 for storing a videodatabase (“videobase”) comprising a plurality of any combination ofconventional programs and interactive games and services, and variablecontent videos; and iv) processing hardware and software 424 formaintaining accounting and support services in connection with videoservices provided.

Simply stated, a variable content video provider system 411-413comprises a video server, such as may be available from a variety ofcomputer vendors, the video server software being enhanced to delivervariable content video services.

Video providers may be further categorized according to the functionsserved and/or the extent and character of the videobase maintained.Central video services providers 411 may be capable of providing agreater variety of video services than for example regional or localservices providers 413. Regional or local services providers 413,however may be the source of local interest video services such as arecurrently broadcast by local television stations. Other video servicesproviders 412 may act as “libraries” for specialized categories ofvideos, as for example an historical video archive of governmentproceedings; or services as for example electronics shopping. Theinternet architecture and the different classes of web sites issuggestive of the wide range of multimedia configurations that arepossible.

A viewer's access to the resources of a video services provider 411-413need not be direct. A requested video may be downloaded, in real time ornon-realtime, to a services provider that may be more economicallyaccessible to the intended viewer. Within the network, some videoservices provider may not directly provide any services to viewers, butact as centralized video originators or depositories for other servicesproviders.

The video server's mass storage random access memory devices 423 forstoring a plurality of variable content videos may advantageouslyimplement the teachings herein with respect to the multiple read/writehead architecture. This would also facilitate the simultaneous retrievalof several versions of a video from a single video source to satisfysimultaneously the particular viewing requirements of several end users.A multiple read head architecture reduces, for example, the number ofcopies of a video that the on-line video server may need to store.

In this context it is also noted that the mass storage devices mayadditionally implement stripping methods to store a video across severalstorage devices. Where cost effective, a variable content video may beentirely or partially stored in RAM.

The particular configuration of a end user's Multimedia Player's randomaccess, storage, memory, processing, and communication means andcapabilities are responsive to, but are not necessarily limited by, theminimum requirements of, for example, a particular service provider. AMultimedia Player configuration, such as detailed with respect to FIG.1, provides the required video accessing and storage, processing, andcommunications architecture required by a network-based remote videoservices provider.

As previously indicated, the Multimedia Player's multi-user andmulti-services modules support separate controlled independent access bya plurality of users of the Multimedia Player's processing, video, andcommunications resources. In addition to the primary video displaysystem 451 supported by a Multimedia Player 431, the multi-user moduleand multi-services module installed also provides services to amonitor/keyboard 452, security system 453, personal multimedia computer454, voice and/or video/voice telephones 455. In this fashion aMultimedia Player acts an intermediate services provider.

The particular location of the Multimedia Player, subsystems, orcomponents, whether within the immediate boundaries of a residence,automobile, or the particular location of the end user, are not limitedherein to any particular arrangement. A variety of configurations arepossible to meet the various needs at any particular time of an the enduser. In a preferred embodiment a Multimedia Player is similar in sizeand weigh to a super thin portable notebook computer. This permits auser to have available all of the functions herein detailed irrespectiveof the user's particular location at any moment in time.

In commercial applications, such as a theater, a Multimedia Player 436may support a high definition projector 459 such as for exampleHughes/JVC Electronic HDTV projector. This particular serviceconfiguration is similar to Alcatel Network Systems and Pacific Bell's“Cinema of the Future” video delivery system which comprises an HDTVversion of Pacific Bell's Advanced Broadcast Video Service and Alcatel'sA1000 AX family of host, remote, and small ATM edge switches andhigh-definition codecs that enable the transmission of digital,studio-quality video through telecommunications networks.

For illustration purposes, connections between Multimedia Players andoutput devices are shown with lines. However, communications may beestablished by any of a variety of wired or non-wired means. Thus, aMultimedia Player 431 need not be directly or indirectly connected bywire to the devices 451-459, 461-462. Further, devices 451-459, 461-462may be connected to a communications port 441-443 which is incommunications with the Multimedia Player 431. The communications portmay be of varying degrees of intelligence and capabilities, it may serveto boost or manage the signal, or have no other purpose than to serve asa convenient outlet in which to plug and unplug devices.

In an embodiment as shown if FIG. 4, analogous to an electrical wiringof a house, the house will be “wired” or “networked” with convenientports. In this instance however, Multimedia Player may be plugged intoany of the ports, self configuring the port addresses so that thedevices that may be plugged into other ports automatically identifythemselves and establish communications with Multimedia Player.

Additionally, Multimedia Player modules may themselves be physicallydistributed over the network. The plug and play of modules across anetwork architecture permits, for example, that the video disc module(101FIG. 1) be physically remote from a Multimedia Player's 431 mainunit and plugged on a port 442 near the television 451. In thisinstance, the case 457 housing the video disc module also houses acompact storage module (105 FIG. 1). Thus, a single video disc modulecan be easily moved from one location 442 to another location 443 whenphysical proximity is required to conveniently replace discs. It isnoted that while the disc module case 457 is connected to a first port442, it would be remotely accessible to a terminal 454 plugged into asecond port 443.

It should be appreciated that the Multimedia Player's core componentsmay be located anywhere inside or outside the house. Specially, where aMultimedia Player includes fans and disk drives, the top of the TV setwould not be an ideal location.

As indicated previously with respect to FIG. 1, the viewer's or, moreappropriately, the user's control of a Multimedia Player is eitherthrough an infrared control keypad, wired or infrared alphanumericcontrol keyboard, voice control, or system controls directly on theMultimedia Player. These controls may be directly incorporated in thedevices accessing the Multimedia Player such as the TV 451.

The novel combination of an external fiber optic based communicationsmodule and a multiple read/write storage module, provides a MultimediaPlayer configuration capable of efficiently downloading significantamounts of full motion video to be viewed, played with, or processed atthe end user's leisure. In such a Multimedia Player, the downloading of,for example, a feature length motion picture, an interactive video game,or a series of lectures can be achieved with unprecedented speed.

Clearly, a Multimedia Player may be configured to duplicate thefunctions of a nonlinear editing system as previously detailed. Both theMultimedia Player 431 and the editing system 471 are capable ofreceiving input from other sources such as for example a digital oranalog video camera 461 and video tape player 462. As is the case withMultimedia Player 431, the editing system 471 is capable of outputtingvideo to, for example, a TV 451 and to a PC 454.

As suggested earlier, an object of FIG. 4 is to convey the concept thata end user's Multimedia Player 431-436 and an editing system 471 canboth upload and download video through the network directly to other endusers 431-436, editing systems 471, and/or to the video servers ofvideos services providers 411-413.

As indicated previously, a Multimedia Player can accommodate a pluralitycompression and decompression technologies to both retrieve anddecompress videos and compress and transmit videos through the network.Preferably, a specific video originating at a digital camera 461,downloaded to a nonlinear editing system 471, transmitted over thenetwork 400 to a video server for retransmission over the network 400 toa Multimedia Player 431 will utilize a single compression technology toavoid compounding the effects of artifacts that may be introduced by aparticular compression technology. Clearly, where the decompressiontechnology resides completely in software, the video itself couldprovide the required decompression software.

As indicated above, variable content video services can be delivered bymeans of any of a number of non-wired based video delivery systems. Forexample, microwave technologies may provide two way video servicesincluding movies-on-demand. In such a system, TV signals are sentthrough the air at very high frequencies such as the 27.5 to 29.5gigahertz microwave band. The network uses a series of transmitters 404,each of which is capable of broadcasting a digital signal within a sixmile radius. End Users utilize a flat, four-square-inch antenna 464mounted on a window to receive the signal. The antenna 464 is connectedby coaxial cable to a decoder 434 connected to a TV set. In anembodiment, a Multimedia Player 434 performs the processing and decodingfunctions required for transmission to a video display.

In a preferred embodiment of a cellular-like system, a video provider'scell site 413 comprises microwave communications, video server, andprocessing systems for establishing a plurality of video andcommunications streams to a plurality of Multimedia Players 431-436.

Unlike traditional film media that permits a program format with only asingle linear sequence of frames, random access video technologies makepossible a variable content video format that is characterized by avariety of possible logical nonlinear sequences of video frames. In avariable content video the artist and program producer are challenged tocreate greater variety in the form of expression, and utilize parallel,transitional, and overlapping segments to provide viewing of a video atthat level of expression, content, detail, and length, that isconsistent with a variety of viewer preferences.

In contrast to interactive motion pictures, and full motion video games,in a variable content video it is principally, although not exclusively,the form of expression that is the object of alternate frame sequences,rather than the story-line. In a variable content video, each of thesignificant scenes and actions can be implicitly expressed, as found forexample in a “PG” rated film, explicitly expressed, as found for examplein an “R” rated film, and graphically expressed, as found for example inan “NC-17” rated film. As a result, unlike motion pictures which arepackaged as a single linear sequence of frames, the U.S. version, theEuropean version, the edited-for-TV version, the “NC-17” version, andthe version addressing each viewer's particular tastes and preferences,reside harmoniously within a single variable content video.

The steps in the production of a variable content video are summarizedwith respect to the flow chart 500 of FIG. 5A. Each scene, segment, orfragment of a segment on a video script is reviewed 501 according to anappropriate video descriptive structure, as for example detailed withrespect to FIGS. 5B-5E. A screenwriter now has the freedom to expand thescenes 502 by producing and adding parallel, overlapping, andtransitional segments, to cover a wider range of expression and storyline without the concern for the limitations inherent in firstgeneration linear programs.

A successful filming 503 of a variable content video is a function ofthe skill of director(s), actors, animators, programmers, etc. toprovide, for example, additional parallel and transitional segments withthe required transparent and seamless harmony. To a great extent this isbeen done in the production of conventional linear motion pictures,often in the anticipation of releasing multiple separate versions.However, by contrast to the editing of first generation motion picturesthat require producing a unique linear sequence of segments, editing ofthis variable content video format requires a parallel non-sequentiallogical arrangement of segments 504.

A segment assigned a content category code may be congruent in one ormore frames with a segment assigned a different category code. Wherenecessary, a video segment is associated with more than one audiosegment, and corresponding separate audio and video category codes areprovided.

As each segment is defined, the beginning frame and end frame in each ofthe relevant segments are identified, and the segment is assigned acontent category code and/or descriptor(s). A segment's content categorycode, keywords, and/or descriptor(s) are also referred to herein as a“descriptor”.

Once a segment is assigned a descriptor, logical entry and exitreferences are assigned 505. The resulting segment definitions aremapped 506 and the required user interface produced. In a preferredembodiment, a video map comprises: i) information directly combining,providing for combinations of, and/or simply defining with or withoutassociated descriptors, segments from within a video; ii) user interfaceroutines particular to the video; and iii) control codes to control aMultimedia Player's playing of the video. The video map's data isprovided with the video's video and audio data.

FIG. 5B illustrates an example of a segment descriptive structureutilized to review the contents of each segment of a video. Generally, adescriptive structure is a matrix of content categories and acorresponding coding scale utilized to assign a content code to asegment of a video. As is detailed below, the descriptive structures arenot limited to the coding of possibly objectionable content material.

This particular segment descriptive structure 510 includes a number ofcontent categories 511 that might apply to most films. This particularsegment category descriptive structure includes, for example, a categoryfor violence, and other categories of possibly objectionable content.The three digit category coding scheme provides for hundreds ofdifferent content categories.

The coding scale 512 mirrors the rating system utilized by the MotionPicture Association of America (General Audiences, Parental GuidanceSuggested, Parents Strongly cautioned, Restricted, No Children Under 17Admitted: G, PG, PG-13, R, and NC-17 respectively), but provides a moredescriptive coding scale 512 for the structure, as shown. Each number519 in the matrix represents a particular segment coding choice.

Referring now to FIG. 5C, the contents of a segment may be furtheranalyzed with respect to a segment element descriptive structure 520.This structure provides for the coding of a segment with respect to thedevelopment of a number of elements 521 such as character, location, andtime. This structure also provides for the coding of a segment withrespect to the level of detail 522, and the level of expertise 523 thatmay be required by the segment. These elements are provided at a varietyof levels, and a segment may be coded accordingly. The elementdescriptive structure 520 indicates that, for example, a segment'scharacter development may range from none to extensive.

Referring to FIG. 5D, a separate segment inclusion descriptive structure530 provides a coding scale to identify the degree of detail in asegment. In this structure 530, the segments may be coded according tothe level of inclusion/exclusion 531 appropriate to the segment. Thecoding indicates if the segment is required for a highlight, summary,condensed, or detailed versions of the video. This descriptive structureis particularly directed to the coding of news videos and otherprogramming where the length of the presentation can have greatvariation. In a similar manner, an individualized descriptive structuremay be configured to address the specific requirements of one or aplurality of categories.

Alternatively, or additionally, a video segment descriptive structure,as shown in FIG. 5E, may be implemented that is not category specific.In this example, the segment generalized descriptive structure 540incorporates the MPAA's movie rating system, whereby segments areassigned a code 541 (rating) from a coding scale incorporating the MPAArating symbols. Determination of each segment's coding symbol is similarto the manner in which the MPAA rating system is applied to a motionpicture. A number of other available rating systems may be implemented,including, for example, the rating system advanced by the Film AdvisoryBoard, or any age-based (e.g. Adult) or class-based (e.g. Family) ratingsystem.

Additionally, segment descriptive structures and content categories maybe tailored to, and/or be specific to, the particular general subjectmatter of a video or of a class of videos. For example, a scienceprogram may require a different set of content categories, contentcategory definitions, and/or an application of the definitions than maybe required by a news program, or an adult motion picture. Contentcategories and the definitions may be context sensitive, e.g., applieddepending on the context, or absolute, e.g., applied irrespective of thecontext.

As previously defined, herein the term “content preferences” ought to beunderstood as further comprising “technical preferences”, and the term“content” ought to be understood as further comprising the technicalaspects of a video. Accordingly, segment descriptive structures comprisethe technical aspects of the video content and/or presentation. Thetechnical aspects include, for example, the type and duration oftransition effects utilized between segments, the incidence of edit cutsand “image changes” within a predefined time period, and the differentcamera angles utilized.

Music videos, for example, are characterized by a very high incidence ofedit cuts and image changes. A viewer viewing a music video may preferto define an incidence of image changes that differs in its apparentvelocity from that of the tempo of the music. That is, a viewer mayprefer to reduce, if not entirely eliminate the kind of rapid firechanges in images that characterize many music videos.

Similarly, the transmission of sporting events also lend themselves toautomatic customization responsive to the technical preferences that arepart of a viewer's content preferences. For example, the broadcasting ofAmerican football games by major networks are distinguished from less“director heavy” broadcasts by the incidence of image changes and theutilization of multiple camera angles. In the viewing of a footballgame, a viewer may prefer, for example, that shots of the coach pacingthe sidelines, and close-ups of the quarterback immediately prior to thesnap of the football, may be replaced by wider angle camera shots thatpermit viewing the defensive alignments, or, alternatively, replacedwith close-ups of the cheerleaders. Here the issue is not to skip asegment or time-compress the game, rather to select a pace andperspective more suited to a viewer's preferences.

Establishing of technical preferences with respect to the viewing ofsporting events is particularly advantageous in terms of enabling theviewer to determine whether or not the playing of a contest shouldinclude the display of scores or other information from other contests.For example, since a preferred embodiment permits a viewer to view afootball game in a fraction of the actual time, a viewer may desire toexclude any information with respect to other contests, if the viewerexpects that the viewing of the current contest will be followed by aviewing of another of the contests simultaneously occurring.

To serve this object, the transmission requires a separation of theinformation in a manner analogous to the separation of video, audio, andsubpicture data in a DVD. In this particular example, the informationrequired to create a display of the scores is transmitted as subpicturedata, and the Multimedia Player selectively creates, responsive to aviewer's preference, the integrated display. For these purposes, displayalso relates to audio content, including, for example, a sportscasterscomments about another contest.

The same methodology can also be applied to other programming that alsocurrently display a plurality of windows, e.g. financial shows includingmarket and news information. In these cases the video information istransmitted with the required selection data to permit a combineddisplay of the video/data streams consistent with a viewer'spreferences.

A video and data integrated display may include the overlay and/orsizing of windows as in current broadcasts, and the particular displaystyle could also be responsive to a viewer's preferences. Insophisticated embodiments, the viewer is provide the kind of controlover the display as is afforded by the multitasking of applications in aWindows environment. Further, windows from separate applications,channels, broadcasts, and/or multimedia, from a combination of real-timeand/or non-realtime, remote and/or local sources, may be assembled as anintegrated display responsive to a viewer's preferences.

FIGS. 5B-5E are examples of an overall framework for segment analysis,the actual segment descriptive structure and complexity utilized may behighly tailored by the producer of a video to reflect the specificcontent and technical aspects of a video without being limited by thestructures which may be found to be commonly utilized in other works.

For example, a simplified content coding system may be based on the“flagging” of segments that may not be suitable for children. Segmentsnot suitable may be defined, for example, as segments providing contentand form of expression which, in a conventional sense, is deserving of arating other than a MPAA “G” rating. The flag, for example, a singlebit, is independent of the specific nature or content of the materialwhich may not be suitable for a viewer. Consequently, all segmentscontaining material which may potentially be unsuitable, receives thesame flag or code. The flagging of segments, is an example, of asimplified, efficient, although limited, method of coding segments.

Each video producer is offered the flexibility within an overall codingsystem to determine and include only those categories that may berelevant to a particular video, and to add categories as the producerrequires. Similarly, the producer is offered some flexibility indetermining the labeling of the coding scale.

Meeting the objectives of being able to provide both a standardized setof descriptive structures that will permit the automatic application ofa viewer's content preferences to a variety of videos, and provide theproducer of the video the flexibility described above, are accomplishedby, for example, assigning unique category codes to each set ofpreestablished standardized content categories and by reserving a rangeof category codes that will be recognized by the system as requiringinteractive input by the viewer. For example, category codes ending in9, codes with a tens digit being a 9, and or codes from 900 to 999(“producer code”) are reserved as independent of the standard categoriesshown.

Producer codes signal to the system software to elicit the viewercontent preferences. Similarly, as the coding scale is relative instructure, different descriptions for any category coding scale might beutilized without affecting the applicability of a preestablished viewercontent preference for that category.

In instances where a desired coding scale is not accommodated by thestandardized structure supplied, the producer need only assign aproducer code, if required by the particular implementation, and buildwhatever scale he/she may deem desirable. A coding system may range froma simple “Yes/No” coding to a sophisticated three dimensionalrepresentation of multiple coding scales.

Additionally, commands may be issued by software associated with thevideo to inhibit the application of preestablished content preferencesand require the viewer to address a video's specific descriptivestructure regardless of the category codes utilized.

In an embodiment, each segment is alternatively, or additionally,analyzed as to subject matter and assigned the necessary keyword(s) toprovide effective keyword retrieval and additional user viewing controlcapabilities. This will be of significant value in retrieving videosegments from a videobase, such as may be constructed from a collectionof news or educational videos.

Keyword indexing of the segments provides the capability for inhibitingthe viewing of undesirable subject matter, or assisting in the retrievalof desirable subject matter where the descriptive structure may notadequately cover a specified category or subject matter. For example, aviewer may not desire viewing scenes of a flag burning. Key word controlwould inhibit that scene or scenes from being viewed by that particularviewer. Alternatively, a key word search would permit a system user toefficiently retrieve all flag burning segments that may be included inthe videobase. Keywords, therefore may be utilized to exclude as well asto include segments in the playing of video content, as, for examplepermitted in a SQL database search.

It is noted that keywords are but one example of other descriptors thatmay be utilized to convey information as to the content of a video'ssegment.

The above are presented as examples of the great variety of contentcoding schemes that may be implemented alone or in combination to meetparticular objectives of a video or classes of videos.

An example of the preparation of a variable content video is furtherdetailed with respect to FIGS. 6A, 6B, 6C, and 6D. FIG. 6A illustratesan example of a conventional motion picture program 601 in which thescenes 602 of the video are arranged as a unique sequential arrangementof frames 604.

In a variable content video, the various scenes or chapters 602 of thevideo are divided into appropriate segments 603 according to theevaluation or coding of the contents of the scenes or chapters. Eachsegment 603 is defined by a beginning and ending frame and comprises anynumber of frames 604. In this example, scene three is divided into foursegments, in which segment 3 ii 611 begins at frame 4112 and ends atframe 6026. The next segment, 3 iii, begins at frame 6027. Segment 3 ii,which in a conventional motion picture contributes to an “R” rating forthe video, includes frames depicting explicit bloodshed. The contentcode of segment 3 ii is indicated by the numeral 3 in the cell 619 of anappropriate descriptive structure.

Referring now to FIG. 6B, to provide for the option of editing-out theexplicit bloodshed in a variable content video, the video map includesan additional segment definition 621 beginning at frame 4112 and endingat frame 5205. The end of this segment 621 is linked to a newtransitional segment 622 beginning at frame 35205 and ending at 35350,the end of which is linked to frame 6027. In this fashion, frames areomitted and added to provide a continuous transparent edited version ofany segment of a scene. This frame sequence 621/622 is associated with acorresponding content code 629 to indicate the absence of bloodshed.

In all other respects the segments 621/622 are equivalent to theoriginal segment 611. That is, it transmits essentially the sameinformation but at a different level of explicitness.

To provide for the option to include a graphic level of bloodshed, thevideo map includes an additional segment definition. Referring to FIG.6C, in this case, only 66 frames of the “first” segment 611 are“ignored”, and new segment definitions 631 and 632 are created. Segmentdefinitions 631 and 632 accommodate the graphic bloodshed included in anadditional segment 633 beginning at frame 35351 and ending at frame38975. This frame sequence or segment definition 631/633/632 isassociated with an appropriate content code 639 indicating the graphiccontent of this sequence.

In this manner, parallel and transitional segments provide a descriptiveselection mix ranging from a segment combination excluding bloodshed621/622 to a segment combination including graphic bloodshed631/633/632, as well as the segment combination including explicitbloodshed 611. As a result, the particular scene of which these segmentsare a part can be viewed at any of the three content levels for thatcategory.

A scene may include subject matter of more than one category. In suchcases, overlapping segments and transitional segments are provided topermit viewing of one subject matter at one content level and viewing ofanother subject matter at another level.

For conventional first generation videos (e.g. linear motion pictures),the editing process operates in a like manner, except that thetransitional segment 622 is not available to make the continuoustransmission from frame 5205 to 6027 seamless.

In the absence of, for example, a parallel, transitional, or overlappingsegment to render the skipping of the playing of a segment artisticallyas well as technically seamless, the video map, may identify a segmentfrom somewhere else within that video that can be utilized, i.e.“grafted” in the place of the skipped segment to enhance the artisticseamlessness of a scene. A grafted segment need not be of the sameduration as the segment it replaces.

By way of illustration, in customizing the playing of the motion picture“The Hunt For Red October”, the skipping of a graphic violence segmentresulted in a “jump cut”, i.e. an artistically not satisfactorytransition in which the principal actor went from camera left to cameraright instantaneously. The method of grafting yielded to possiblesolutions. A first embodiment, advanced or interleaved the playing of aportion of the subsequent scene which was taking place in the story lineat a more or less same time as the edited scene. The second methodutilized some general nondiscriptive segment that can could also begrafted to create a cut away. In this case, one of the shots of thesubmarine moving underwater taken form an earlier occurring sceneprovided the suitable content. By these methods, the grafted contentprovided the sufficient time to camouflage the transition that isprovided by the violent segment deleted from the playing of the scene.

To the extent that it may be necessary, advantageous, or of noparticular consequence, a grafted segment may be played at both itsoriginal location and at its new location. This was the case with theutilization of the submarine segment, but not the case in the advancingof a segment of the following scene.

Referring now to FIG. 6D, the location of the net additional frames thatresult from the additional segments cause some frames to benon-sequentially placed within a variable content video 641. FIG. 6D isillustrated to diagrammatically emphasize the resulting sequential andnon-sequential random-like arrangement of video segments in a variablecontent video. This is shown for example, in the segment definition631/633/632 depicting explicit bloodshed and the correspondingnon-sequential frame sequence 642.

In an embodiment, a video map comprises the various segment combinationsthat are defined. For example, a video map would provide the followingsegment chains: 4112-5109|35351-38975|5175-6026,135-4,6027;4112-6026,135-3,6027; 4112-5205|35205-35350,135-1,6027. This map wouldenable, for example, to automatically retrieve the segment chain definedby frames 4112-5109, followed by segment defined by frames 353514-38975,and followed by the segment defined by frames 5175-6026 in response to aviewer's preference for a graphic level of violence (135-4) 639. It isnoted that, for simplicity of presentation, in each of the segmentdefinitions above, the next logical segment is the same, namely thesegment beginning with frame 6027. As suggested earlier, this need notbe the case.

A video having a video frame identified by number 5100 and a video frameidentified by number 5200, need not have video frames identified bynumbers 5101 to 5199. It is also noted that segment definitions need notbe based on frame numbers, any timing or logging format, or physicaladdressing format, that defines the video material may instead or inaddition be utilized. The segment definitions may be dynamic and can beautomatically redefined or renumbered as a particular system or platformrequires. The exact physical location of a segment may be a function ofthe hardware and software of the host media.

A video map need not include all the segment information, codes, and/ordescriptors that are prepared in the production of a variable contentvideo. A simple video map may comprise one or a plurality of tables ofsegments, linkages of segments, and/or pointers among segments,associated with a particular version. Each table, set of linkages,and/or pointers being associated with a single code, rating and/ordescriptor.

It should be appreciated that as the content and technical categoriesthat are utilized in a video increase, a video map (i.e. navigationdata) as, for example, implemented in the DVD specification begins tocollapse under the possible permutations. In other words, in certainembodiments, predefining program chains may not provide the mostefficient utilization of data space.

Accordingly, alternatively, or additionally, a video map may compriselinkages only where required to skip over, for example, parallelsegments. Such a video map, principally comprising segment definitionsand associated descriptors provides more flexibility by permitting tocreate on-the-fly the combination and/or linked sequences of segmentsresponsive to each of a viewer's preference in each of a plurality ofcontent categories and/or set of keywords.

In the case of DVDs, such an embodiment may require that the video mapbe provided by a source other than the DVD, and may require enhancementor modifications, to the DVD play or navigation software, which areoutside the DVD specification. Clearly, from a technical perspective ofwhat can be accomplished, a Multimedia Player need not be limited toplaying a DVD in the manner prescribed by widely accepted standards.

The art of editing a variable content video is intended to significantlytransfer censorship, and time-constrained editing decision making fromthe producer and/or editor to the viewer. The editor of a variablecontent video is concerned with maximizing the content range of thevideo produced to permit the creation of a greater number of versions ofa video and thus appeal to a wider audience and to multiple viewings.

The complexity of a variable content video program/game is only limitedby the requirements, desires, skill, hardware/software, authoring tools,and resources available to the video editor. To that extent, it isintended that the editing functions, in particular, be assisted byintegrated computerized editing resources.

A variable content video editing system is in terms of the hardware andunderlying application software not significantly different from anumber of nonlinear editing systems that are available, such as AvidTechnology Inc.'s “Media Composer 8000” and “Film Composer”, ImMIX“VideoCube”, Data Translation's “Media 100”; and digital audio editingsystems such as “Avid's Audio Vision”™. The teachings of the followingU.S. patents are incorporated herein by reference: U.S. Pat. Nos.4,449,198; 5,109,482; and 4,979,050.

The Media Composer 8000 utilizes a Quadra 950/28MB based highperformance personal computer system including: audio converter andco-processor board, video RAM and co-processor board, video slavedriver, enhancement board, black burst generator, effects module,compression hardware, SCSI II board, deck control, high capacitymagnetic drives, modem, speakers, two 20″ color monitors, keyboard,mouse, manual user interface, cables and power strip.

The editing software of these systems is principally directed atfacilitating the editing of video material and the creation of specialeffects. To that extent, the software and user interface is similar tothat required in a variable content video editing system. However, avariable content video editing system is significantly and conceptuallydistinguished from the prior art by the methods and software routinesassociated with the production of a video map.

In prior art nonlinear editing systems, the editor utilizes the editingsystem to create a video comprising a linear sequence of frames. Thatis, in spite of sophisticated video effects, the end product of theseadvanced nonlinear editing systems is a video of quite conventionallinear characteristics. Certain editing systems output an edit decisionlist or a negative cut list utilized to assemble the negatives of a filmin a conventional manner. When the editor produces more than one linearversion of a video, each version is complete in itself.

In a variable content video editing system, as for example, Sonic'Solution's DVD authoring systems, the end product of the editing processis a videobase comprising a video map that identifies the content andwell as the location of segments for each of a plurality of versions.The video map is not directed towards producing a single linear versionbut towards the plurality of versions that, for example, the permutationof a plurality of content categories and coding levels makes possible.

It should be appreciated that in the production of a variable contentvideo, the task of the editor is to create a videobase of logicallyorganized video segments. The logical organization being the video map.Thus, in a variable content video editing system, conventional editingsoftware is enhanced to facilitate the creation of the video map, whichin the case of a DVD is known as navigation data.

FIG. 6E is a representation of an editing screen 651 displayed in avariable content video nonlinear editing system. This particular screenidentifies the video material 652 available to create the variousversions 653 of a segment, and the resulting map 654.

An editor selects a particular scene and segment to edit 655, identifiesthe video and audio material corresponding to that segment 652,identifies the content category 656 for the segment, and proceeds toedit a segment 661. Normally the editor will begin editing a segment forthe most explicit level that the editor desires to produce.

The editing of a particular segment at a given content code is executedin a manner similar to that available in other nonlinear editingsystems. In this case, however, the frames are dropped in the applicablepredefined or editor defined content code level. In this example, theeditor is first producing a segment 661 at a graphic level of violence.

If the editor wishes to produce versions of the segment at differentlevels of explicitness, the editor may repeat the process above.Alternatively, the editor may copy an edited segment 662, and paste itto a different content code level 663. The editor then may edit outmaterial inconsistent with the coding level, and add parallel andtransitional material that may be required.

As the editing is being accomplished, the software composes the videomap 654, which may be directly accessed and edited by the editor. Whencompleted, the map may be automatically keyed or configured toaccommodate the requirements of the particular device to which the videois to be downloaded, for example to a DVD and/or to a video server.

It is noted that an editing system usually comprises more than onemonitor, and that windows may be arranged by the user as the userprefers. The screen illustrated in FIG. 6E shows some, but clearly notall of the tools that may be made available or are available.

It is intended that the variety of teachings with respect to a video mapand the mapping of a variable content video be understood to comprise avariety of video mapping methodologies. The particular mappingembodiment utilized being responsive to the particular application,complexity, sophistication, and capacity for customization that may berequired. Specifically, it ought to be understood that embodiments ofthe teachings herein are consistent with program chains and thepreparation of program chains for DVD video.

It is specifically intended that the requirements resulting from thezooming and audio teachings herein be accommodated and made an integralcomponent of the video mapping and the special effects software of avariable content video nonlinear editing system.

A Multimedia Player embodying the teachings of a variable content videoarchitecture provides each viewer the opportunity to establish contentpreferences. In a preferred embodiment, providing great potential forcustomizing the playing of a video, content preferences for each of aplurality of a viewers are established with respect to a level ofcontent, such as detail, in each of a plurality of content categories.

A random access device as per the present invention provides each viewerthe opportunity to preestablish both any number of generalized,personalized video content preferences, and program/event specificcontent preferences, identifying the viewing preferences in each of anumber of content categories with respect to a particular playing timeand video.

Generally, the design of a viewer's content preferences elicitingroutines is responsive to the particular content descriptive structurethat was implemented in analyzing the content of the video. As isdetailed below, the content preferences are established or capturedprior to a transmission of a video to a viewer's receiver or display, orimmediately in advance of the transmission of a selected video, so thatduring the transmission of the video, viewer intervention is notrequired.

FIG. 7A illustrates a viewer's content preferences selection screen 701specific to the content of a selected video. In this example the vieweris provided the opportunity to establish the level of explicitness in anumber of different content categories 702. Depicted by bold boxes 703is the viewer selected level for each category. The viewer in this casehas elected to omit bloodshed 703 in his/her viewing of the video.

In this particular viewer interface, viewers indicate their selectionsby following the entry requests 704. A variety of means, such as keys ona remote control, are provided for the viewer to indicate the categorythey wish to access 705 and the viewing level for the category 706.

Also illustrated in FIG. 7A is the labeling of the conventional functionkeys 707 of the devise in synchronization with the screen display. Oncethe screen is exited, the function keys provide conventional VCR typecontrol over the playing of the video. Additionally as is suggested bythe “Skip” key 708, functions are provided that utilize the video mapcapabilities.

FIG. 7B illustrates an example of a screen 711 for establishing contentpreferences in each of a plurality of content categories 712 withrespect to a plurality of programming or subject matter preferences 716for each of a plurality of viewers 713. This particular graphical screenwould be used to initially establish all the users and their contentpreferences. As in previous examples, a viewer is provided theopportunity to select the level of explicitness in a number of differentcontent categories 712.

The screen also illustrates other options available to the viewer. Forexample, the option is provided to assign each viewer 713 or combinationof viewers 714 in a household individualized content preferences. Accessto the system resources and the establishment of the content preferencesare access protected 715. Further, while a viewer may establish a singlecontent preference table to serve, for example, both games and motionpicture applications, a viewer may assign a different set of contentpreference to the selection of different categories of videos 716.

In this particular screen design, viewers indicate their selections bythe use of a pointing 717 device such as an infrared mouse, or a remotecontrol as detailed with respect to FIG. 2.

It should be noted that the teachings above are not confined to avariable content video, clearly the teachings are applicable to anylinear or nonlinear video. Specifically, interactive video gamesutilizing full motion video segments can also benefit from providing theviewer/player of the game the option to preestablish video contentpreferences in addition to the gaming options which may be included inthe video game software. As in a variable content film, in a interactivevariable content video game, the video segments shown are consistentwith the player's video content preferences.

FIG. 7C illustrates one of a plurality of video specific selectionscreens. This particular screen 721 is tailored for the retrieval ofnews programming. The requirements specified by this screen may be setby the viewer to be responsive to the viewer's content preferences andprogramming preferences as defined with the use of, for example, thescreen of FIG. 7B. Additionally, the stories themselves may beautomatically selected in response to the viewer's preestablishedspecific news category preferences. In this example the viewer hadpreviously indicated a preference for technology related news 723, andis additionally provided the opportunity to select the level of detail722 that the viewer desires in each of a number of news stories relatingto the selected news category.

FIGS. 7D, 7E, 7F and 7G, are examples of a set of screens utilized inthe retrieval of a video. The set of screens are drawn with an aspectratio of 1.33 rather than the HDTV aspect ratio of some of the otherpreviously illustrated screens. The screen set is intentionally designedto have a simple and consistent “look and feel”.

The functions of the system are accessed by three commands and tensingle digit numerals. This permits viewer access by means of currentvoice recognition technology or the keys available in most remotecontrol devices.

The description that follows with respect to FIGS. 7D-7G are in terms ofthe three function keys and a numeric key pad available in an ordinaryremote control devices. In this particular embodiment, the Chan+(channel change up), Chan− (channel change down), SEL (select key), andthe numeric keys are utilized.

The screens inform the user which key is required for a particularfunction. The Chan+ 731 and Chan− 732 keys are utilized to scrollthrough the available selections 733. When a particular highlightedselection is desired, the SEL key 734 is utilized. The availableselection are retrieved from a dynamic relational database.

Numeric keys are assigned various functions. For example, the 0 key 735is utilized to access a help screen, and the 9 key 736 is utilized toreturn to a previous screen if available or to exit.

Referring now to FIG. 7D, in instances were viewer control is enabled,that is at least one viewer has controlled access to the video services,the viewer access screen 741 is presented to the viewer. In the vieweraccess screen 741 as in the other screens, the Chan+ 731 and Chan− 732keys are utilized to scroll through the available selections 733. Inthis screen, the selections 733 identify each of the various viewers ina household. If Mom is the viewer, she would cause the highlighting ofthe Mom label 742 and depress the SEL key 734.

In this example access to the video services associated with Mom ispassword protected. Therefore, a password entry routine is displayed 743upon the pressing of the SEL key 734.

While a viewer label is highlighted, the content preference screen maybe retrieved by pressing the 8 key 744. If access to that viewer'scontent preference screen is password protected than the password entryroutine 743 is also displayed.

A parent wishing to modify a child's content preferences, wouldhighlight the child label, press the 8 key, upon which the systemrequires the entry of the parent's password. A child wishing to use thesystem would highlight the child label and press the SEL key. A passwordneed not be required to access the video services that have beenpreestablished by the parent for the child.

To add or modify viewer's, the 7 key 745 provides access to the viewermaintenance screen. To personalize the viewer labels, the numeric keypad may be utilized as is practiced in the art to create an alphacharacter string. Alternatively, a selection listing provides theletters of the alphabet and/or a list of common first names and labels.

FIG. 7E illustrates a viewer's content preferences selection screen 751.In a manner similar to that detailed with respect to FIG. 7D, the vieweris provided the opportunity to select the level of explicitness in anumber of different content categories 752.

To select the level of explicitness, the viewer highlights the desiredcontent category 752, and presses the numeric key corresponding to thedesired level of explicitness or detail. For example, highlighting theviolence label 754 and pressing the 2 key prevents the display ofexplicit or graphic violence. Depicted by bold boxes 755 is the viewerselected level of explicitness or detail for each category.

FIG. 7F illustrates a category selection screen 761. The listedcategories 762 are responsive to the viewer being served. The categoryselections 762 may be modified by pressing the 6 key 763, which providesaccess to the category inclusion screen. The category inclusion screenis similar to the category selection screen but list all the availablecategories indicating which are included and which are excluded. Thenumeric key pad is utilized to change the category status. Access to thecategory inclusion screen is also password protected.

It is intended that the teachings herein are integrated with broadcastsvideo services available to the viewer. This is represented by the 5 key764 that causes the system to provide broadcast services.

FIG. 7G illustrates a program selection screen 771. The programsselection 772 is responsive to the category previously selected. Whereavailable, the viewer may obtain a promotional clip or summary byhighlighting the desired program and pressing the one key 773. Thisscreen also provides access to the content preferences screen. In thiscase, the screen is preceded by a password request if not alreadyestablished, and a request to the viewer to indicate if the contentpreference changes are program specific or not.

Alternatively, or additionally, to preestablishing content preferencesin advance of playing a video, the content preferences are establishedduring the viewing of a video. For example, pressing the SFWD (skipforward) key or the appropriate editing keys (FIG. 2, 281/271) duringthe playing of a segment coded as containing an explicit level ofbloodshed, would cause all segments of bloodshed with an explicit orgraphic level to be skipped. Responsive to, for example, system defaultor interactive query, the viewer's content preferences could be updated.

Interactive setting of content preferences is particularly advantageousin those instances where the subject matter of a segment does not lenditself to a preestablished standardized set of content categories. Forexample, in the viewing of a debate, a viewer could elect to exclude theviewing of a particular participant.

Generally, with the respect to the functions or capabilities which areenabled by the use of a password, or other access control means, aftersome period of inactivity with respect to the particular function, e.g.,the playing of a DVD, the access permission level is restored to a levelprior to the entry of a password, i.e., the access protectedcapabilities are no longer available to a viewer without the entry of anappropriate password. For example, after a fifteen minute period ofinactivity following the access controlled and permitted playing of an“R” rated motion picture, the playing of the same motion picture is nolonger permitted. These and other access functions may be responsive tosystem defaults and/or user requirements. Herein, the terms “password”and “access control” or “control codes”, are any means, e.g. a key orvoice signature, which may serve to verify permitted usage.

Referring to FIG. 1, a Multimedia Player's disc module 101implementation may incorporate a variety of, for example, technologies,configurations, formats, compressions, and methodologies. The teachingsof U.S. Pat. Nos. 4,872,151 and 4,873,585 are incorporated herein byreference.

Generally, in, for example, a laser readable disc implementation, theentire variable content video (video/audio and video map) is provided ina format similar to that required by the video images contained in thedisc. Specifically, in a DVD implementation, the video map or navigationdata is included in a digital format and the video content is includedin a digital compressed format in one or more spiral tracks.Alternatively, the data is provided in the video/data disc in adifferent format from the particular video format implemented. Forexample, where the video utilizes analog/optical technologies, the videomap utilizes digital photomagnetic or magnetic technologies.

In a second alternative, the video map and other data is separatelyprovided by a removable memory media 104, an user access media 144, ordownloaded by means of the communications interface 102. For example, aMultimedia Player simply configured and comprising, a DVD drive 101 anda micro floppy disk drive 104 or modem 102 provides editing out benefitsfor DVDs storing a conventional linear video. In this configuration, themicro floppy disk provides the video map, user interface and othercontrol programs particular to the motion picture. Additionally, thedisk may serve to store a viewer's generalized or video specific videocontent preferences.

The customization of a conventional linear program, while suffering, asdoes edited-for-television programs, from the lack of transitional,parallel, and overlapping segments, provides a library of full motionpictures to which the teachings herein may be applied. In thoseinstances where the authoring of the video did not include theproduction of a video map, the video map is likely to be retrieved froma source, e.g., a web site, other than the source of the video, e.g. aDVD. If the video does not directly provide identifying information, theMultimedia Player's software extracts from a previously designatedlocation of the video, e.g. 5 minutes into the video, a sufficientamount of data, e.g. a plurality of bits, expected to provide a uniquesignature which when compared to a database of previously storedsignatures, would serve to identify the video being played. If thedatabase of signatures and video maps are not locally accessible oravailable in the Multimedia Player, the Multimedia Player automaticallyestablishes a communication with a remote source, provide the signatureinformation, and download the video map. If the initially obtained datais insufficient to establish the identity of the video, the remotesource instructs the Multimedia Player to obtain data from a locationidentified by the remote source. If the remote source has access to thecontent of the video, the remote source need not maintain a database ofsignatures, extracting the information in parallel with the MultimediaPlayers' retrieval of data from the video.

Upon a playing of a video, the control program causes the reading of thevideo's identifier from the video source 101, searches the mass memoryfixed storage device 103 for a corresponding viewer content preferences,or applicable generic preferences, and upon viewer confirmation appliesthe stored viewer preferences to the video map.

With respect to control programs, scheduling routines, viewerpreferences, video map, and other principally software elements, it isnoted that these may be separately or jointly stored in any one of aMultimedia Player's various firmware/hardware memory devices. Forexample, the viewer's content preferences are stored in nonvolatileresident memory 115, in the memory of the fixed or removable memorysubsystem 103/104, a user's optical read/write access card or electronicmemory card 144, or from the respective read/write video/data disc 101.In an interactive video game application, data in general, and gamesoftware in particular, for example, may be downloaded to the hard disk,reserving subsequent access of the laser disc for video/audio retrieval.

Generally, a Multimedia Player's control programs 121 generate a segmenttable (i.e., in the case of a DVD, extracts a program chain) reflectingthe application of a viewer's content preferences to the video map. Theprogram chain provides the control program's segment scheduling routinesthe information to cause the automated logical selection of sequentialand non-sequential segments of the video responsive to the video map,the viewer's content preferences, and the logic of the gaming softwarewhere applicable. The processing of the control programs is principallya function of the system CPU 111 and system RAM 112.

A Multimedia Player's video random access retrieval architectureprincipally comprising the video/data disc module 101, video CPU 113,video buffers 114 and processing capabilities, provides for theretrieval and transmission of selected sequential and non-sequentialvideo segments stored in the video disc, and utilizing, for example,constant angular velocity, constant linear velocity, analog, digital,and/or any combination of these and other laser technologies.

A Multimedia Player's disc module 101 comprises laser disc technologydistinguished principally in the cooperative operation, responsive tothe instructions of the segment scheduler, of one or more read/writelaser units and/or video buffers to produce a continuous transmission ofnon-sequential video segments. In a laser-based random access multipleread/write architecture, each read/write unit assembly and operation isprincipally equivalent to corresponding laser-based assemblies found inthe prior art, in which a laser beam reads and reproduces memory signalsfrom a disc. U.S. Pat. Nos. 5,280,462; 4,972,396; 4,871,903; and4,701,896, are incorporated herein by reference.

FIG. 8A shows a video disc 801 having therein, in a laser readableformat, sufficient recording area 811 to store a variable content video.The recording area 811 of the video disc 801 is shown as substantiallyconcentric tracks lying in a single plane. Alternatively, the recordingarea comprises a multitude of quasi-concentric tracks forming one ormultiple spiral tracks. Additionally, as is implemented in the highercapacity DVDs, single tracks can be provided in one or more planes oneach side of the disc, as well as on both sides of the disc.

In a preferred embodiment of reading non-sequential video segments froma single video source, a first reading unit 821 is directed by thesegment scheduler to retrieve video information corresponding to thedesired frames 4112-5109 of a first, or current, video segment from thevideo source. Concurrently with the first reading unit 821 reading theinformation from the first segment, a second reading unit 822 ispositioned, according to the video map and the segment scheduler, toread within one revolution of the disc beginning frame information of anext non-sequential segment from the same video source.

In this example, the next non-sequential segment begins at frame 35351.Concurrently with the first reading unit 821 reading the currentsegment, the second reading unit 822 is caused to read into a videobuffer (114FIG. 1) that portion of the next non-sequential segmentbeginning at frame 35351 necessary to provide a seamless transition fromthe first reading unit reading of the current segment ending at frame5109 to the second reading unit reading of the next non-sequentialsegment beginning at frame 35351. The video buffer, thus containing thesegment information necessary to provide a synchronized, seamlesstransition from the first segment to the second segment without any gapsin the transmission of the retrieved video segments as a continuousvideo.

Concurrently with the second reading unit 822 reading the nextnon-sequential segment, now a current segment, the first reading unit821 is repositioned to begin reading of a next non-sequential segmentbeginning at frame 5175. By the time the second reading unit 822completes reading the current segment at frame 38975, the first readingunit 821 has read frame 5175. The process, analogous to a relay race,repeats itself until the last desired segment has been read.

A video source herein is not defined by physical characteristics. Anynumber of components, devices, or systems; integrated or acting incoordination or combination comprises a video source. For example, anarray of drives storing a video comprise a single video source. In suchan architecture, the first reading unit may read information from afirst drive and the second reading unit may read information from asecond drive. A drive may have one or a plurality of reading units.

In an interactive video game application, a multiple reading unitarchitecture is advantageously utilized to additionally provide fastervideo responses to the user/player's actions. Briefly, while a firstreading unit 821 is reading a first video segment, frames 4112-5109, asecond reading unit 822 is positioned to read a second segment beginningat frame 35351. The positioning of the second unit 822, is responsive tothe option being presented to the player during the reading of the firstsegment, which may require reading the second segment rather thancontinuing reading the first segment or reading the next sequentialsegment. Alternatively, the second reading unit provides overlay imagesin synchronization with the images retrieved by the first reading unit.

Each reading unit's movement over the disc surface is over a designatedradial segment such that the movement of each reading unit over therecorded radius of the disc is not impaired by the movement of adifferent reading unit. In this fashion, the movement of the firstreading unit 821 over its radial segment 831 does not intersect themovement of the second reading unit 822 over its radial segment 832.

It is noted that the reading unit's travel need not be limited to theradial segments. A positioning system providing for the positioning ofthe reading unit at any point over the recording media, provides thereading unit the potential to precisely intercept the beginning of asegment/frame at a precisely defined moment, which is represented inFIG. 8A as the juncture of a radial segment 831 and the beginning offrame 5175. In this fashion, the requirement of reading into a videobuffer can be reduced if not eliminated.

FIG. 8A also shows a third reading unit 823. While a simple variablecontent motion picture application does not require more than tworeading units, the third reading unit 823 is illustrated principally toemphasize that a multiple-read architecture is not limited to tworeading units 821-822, and is available for more demanding interactivevariable content game applications. Further, as illustrated, a readingunit's movements over the recorded surface need not be confined to aparticular quadrant, side of the surface, or radius of the surface. Inthe illustration, the third reading unit's 823 movement over therecorded surface is permitted over the recorded diameter 833 of thesurface.

Alternatively, or additionally, the information is recorded on the laserdisc in a manner that, either through placement or duplication offrames, anticipates the desired and possible position of a reading unit.In this case, even if the movement of the reading units are confined toradial segments, the requirement of a video buffer is for this purposeeliminated. This is represented in FIG. 8A as the various junctures ofthe radial segments and the beginning of the frames.

Specifically, in this architecture, concurrently with a first readingunit 821 reading a current segment from a single video source, a secondreading unit 822 is positioned to be able to intercept and read thebeginning of a next non-sequential segment, in this example frame 35351,at that instant that the first reading unit 822 completes reading thecurrent segment at the end of frame 5109. When the first reading unit821 completes reading frame 5109, the second reading unit begins readingframe 35351, thereby in combination with the first reading unit causinga seamless transition from the reading of the current segment to readingof the next non-sequential segment.

In the next stage, concurrently with the second reading unit 822 readingthe beginning of the next non-sequential segment at frame 35351, now acurrent segment, the first reading unit 821 is repositioned to be ableto intercept and read the beginning of a next non-sequential segment,frame 5175 at that instant that the second reading unit completesreading the current segment at frame 38975. The process continues untilall the required segments are read.

Still alternatively, or additionally, the rotational speed of the discplatter is set sufficiently high to permit the reading unit to read intobuffers sufficient video information to provide the same reading unitsufficient time to reposition and begin reading the next non-sequentialsegment before the video information in the buffer is exhausted. Thiswould, in certain applications, eliminate the need for multiple readingunits.

Specifically, when non-sequential video segments are read from a singlevideo source, a single video source 801 is caused to rotate at asufficiently high rate 841, in this example 60 frames per second or3,600 rpm 841, i.e. twice the rate of 30 frame per second 642, to permita reading unit 821 to both read an amount of a current segment (frames4412-5109) into a video buffer and sufficient for the reading unit 821to be repositioned to read the beginning of a next non-sequentialsegment, frame 35351, before the amount of information in the videobuffer is exhausted.

Reading frames 4498-5109 provides the reading unit 821 sufficient timeto be repositioned to read a next non-sequential segment, frames35351-38975. Concurrently with the repositioning of the reading unit,the video buffer provides the last read frames 4498-5109 to cause aseamless transition from the reading of the current segment, frames4112-5109, to the reading of the next non-sequential segment, frames35351-38975. This process continues until all the required segments areread.

In this architecture, the reading unit reads into the buffer only inadvance of a next non-sequential segment, or continually reads into thevideo buffer as the video information in the buffer is depleted.

A variation of this technique particularly applicable to interactivevideo game applications is detailed with respect to FIG. 8B. In thisexample, a read stream comprises alternating frames from a number ofdifferent video segments. The number of different video segments resultsfrom the attainable effective transfer rates of the system. For example,if the video application requires a transfer rate of 30 frames persecond, and video compression techniques, rotational speed, and/orreading capability of the system can achieve an effective transfer rateof 120 frames per second 843 (FIG. 8A), than four different videosegments can be read “concurrently” by a single reading unit. In such anarchitecture, the frame arrangement comprises a reading stream 851 ofalternating frames from four separate segments A-D and is read at aneffective rate of 120 frames per second. The processing architectureselects the desired segment A, B, C, or D from the read stream 851 togenerate a transmission stream 852, at a rate of 30 frames per second,of the desired frames 351A-353A, 351B-353B, 351C-353C, or 351D-353D.

In this fashion a single reading unit can provide instantaneous shiftingamong a number of different segments. In an interactive video gameapplication, shifting among a number of different video segments can beinstantaneously achieved in response to a players interaction with thegame's software logic.

Further, to enhance the simulation of each video stream, a windowingtechnique, such as shown in the previously cited patent to Blanton etal., in which only a portion of each frame is displayed, is applied toeach frame in one or more of the video streams to enhance the simulationof movement within a multidimensional space and to provide compositeimages of greater complexity.

These and other variations in the particular number and arrangement ofthe reading units, video buffer, and frame arrangement configurationthat is implemented in a Multimedia Player and/or in a video is afunction of the complexity of the video/data, compression/decompressionrequirements, and cost/performance constraints. It is also intended thatthe teachings of the various configurations shown herein and in thecited art may be combined responsive to the particular application (e.g.DVD).

Clearly, with technology continuously achieving greater storage capacityin smaller, faster, and more cost effective storage devices, there is noapparent limitation to the complexity of a variable content video thatcan be commercially executed.

The description above has for simplicity been detailed with respect to areading unit. It is to be understood that a reading unit hereincomprises both reading and writing capabilities operationallyindependent of the operation of another read/write unit in the system'sarchitecture. Additionally, a read/write unit need not be limited to aparticular current technology. Enhancements to the construction of thereading unit itself, such as for example multiple tracking mirrors/beamsplitters, are contemplated to produce faster access times and transferrates. Further, the multiple read/write architecture detailed need notbe limited to a laser readable disc system. In an alternate embodiment,a hard disk drive is modified as per the teachings above detailed tosignificantly increase transfer rates and lower average access times.Clearly, at present, in a hard disk embodiment the read/write units aremagnetic read/write heads.

A random access device's read/buffer architecture, modified as per theteachings herein, is intended to be implemented in a variety of massmemory devices. Embodiments of the read/buffer architecture detailedherein is not intended to be limited to any particular availablerecording medium and recording formats. The teachings herein areapplicable to a number of random access technologies such as, and notlimited to, fixed and removable magnetic, optical, or photomagneticmedia, and digital or analog recording formats. Any combination ofexisting or forthcoming media, format, and compression memorytechnologies may advantageously incorporate the teachings hereindetailed.

The steps comprising the method of playing a variable content video discon a Multimedia Player are principally detailed with respect to the flowchart of FIG. 9A. Beginning at step 901, the viewer selects the desiredvideo disc, e.g., a DVD. Upon selection of the play function 902, aMultimedia Player's software, firmware, and hardware processingcapabilities (“processor”) issue a command to read the viewer controlsetup to ascertain if viewer control is enabled 903. If enabled, theMultimedia Player's handshaking routines request viewer identificationand, if required, a corresponding password 904. If the vieweridentification and password are not found acceptable 905, theappropriate error message is transmitted to the television or similarviewing device 906, and the Multimedia Player is returned to a stateprior to the viewer play request 902.

If viewer identification and password are found acceptable 905, theprocessor checks for other restrictions to a user access 907. Theseadditional restrictions include: time of day restrictions for the user,and/or accumulated usage during specified time frames. If restrictionsare enabled that prevent usage 907, an appropriate error message 909 istransmitted to the television, and the Multimedia Player is returned toa state prior to the viewer play request 902. The user-permissioncapability enables a parent to have complete control over the use of theMultimedia Player, and provides for multiple individualized preferences.U.S. Pat. No. 5,231,661, incorporated herein by reference, titled“Television Viewing Control Device and Method” details “A device andmethod for controlling television usage by children and other users.”

If viewer control is not enabled 903, or if enabled and verification ofthe user 905 and verification of restrictions permit usage 907, programsetup routines are initiated.

Program setup routines 911 include reading, from the video source, videoidentification information. Based on the video identificationinformation, which in addition to including a unique identification codealso contains qualitative and classification video information, setuproutines search to see if a corresponding viewer content preference forthe identified video is available 912. Otherwise, the video's contentcategory structures 913 are obtained from the video source to determineif a viewer content preference is established for each of the video'scontent categories.

Once the viewer's content preferences are established, the processorverifies set up status for editing privileges 914, to determine if theviewer has editing privileges for the class of videos to which thepresent video belongs and the categories included therein. The processorat this point transmits to the television a request for the viewer toindicate if the existing preferences are to be edited 915. If at step914 edit privileges are not available for the viewer, the processorinitiates normal play routines. If the viewer indicates that no editingprivileges are to be exercised 915, normal play routines are initiatedas well; otherwise, editing of the viewer content preferences occurs atstep 918.

The edited viewer's content preferences are interactively verified 919until an adequate category preference match, as required by the videoand the user is established, or the viewer selects to exit. Exiting at919 returns Multimedia Player to a state prior to the viewer playrequest 902.

If a viewer's content preferences for the video are not available 912,or at least one of the categories of the video is not contained in theviewer content preferences 913, then the processor verifies if editprivileges are available for the viewer for the class of videos and thecategories 916. If no edit privileges are available, an exit message 917is transmitted to the television, and Multimedia Player is returned to astate prior to the viewer play request 902. If edit privileges areavailable 716, then editing of the viewer preferences 918 is initiated.

Editing the viewer preferences 918 is supervised to insure that viewermodifications are consistent with the permissions established for thatviewer. Individual viewer permissions are established broadly for anyone or more classes of videos or categories, or specifically for anycategory. Once editing of the preferences is found complete 919, asrequired by the video category listing, play routines are initiated.

Following the enabling of the play routines 921, the video map is read922 from the video map storage media or memory. As previously detailed,the video map defines the sequential and non-sequential segments of theselected video. At this point, the processing capabilities retrieve andapply the viewer's content preferences to the video map 923.

In a preferred embodiment, the application of the viewer's contentpreferences to the video map results in the automated logical selectionof sequential and non-sequential segments of the selected video 924consistent with the viewer's video content preferences and the videomap. In other words, any segments with a content coding higher(abstract) than the viewer-selected content preference for thecorresponding category would not be included in the video produced forthe viewer. The segment selected for viewing having a coding level equalto or lower than the viewer specified content preference for thatcategory is selected and provides, where necessary, the next segmentbeginning frame information. This will skip over parallel segments of alower coding than the viewed segment.

Once the segments to be played and their sequence are determined 924,the random access retrieval and transmission capabilities automaticallyretrieve the selected sequential and non-sequential video segmentsstored in the video storage device, and transmit the video segments as aseamless, continuous video 925.

In a interactive video game, the start and setup routines detailed withrespect to FIG. 9A are integrated with a game's setup routines.

While many interactive capabilities are possible, it should be clearlyunderstood that the playing of a variable content video does not requirethat the viewer preview the contents of segments of the video, and doesnot require viewer intervention or interaction during the viewing of thevideo.

It is emphasized that following the initial setup of a Multimedia Playerwith a viewer's content preferences, a subsequent viewing of a variablecontent video conforming to a standard descriptive structure onlyrequires the pressing of a play key. After the pressing of the play key,the Multimedia Player automatically initiates playing of the videowithout the necessity of any further viewer interaction or instructions.In other words, in a standardized content descriptive architecture, oncea Multimedia Player initially learns the viewer's content preferences,it does not require any more of the viewer than, for example, aconventional laser disc player.

Similarly, in the playing of an interactive content-on-demand game, oncethe Multimedia Player initially learns the viewer/player contentpreferences, the gaming interaction proceeds transparently of the videoediting functions.

With the object of promoting multiple plays or viewings of a video bythe same viewer, the video and video map are authored and the MultimediaPlayer's software is enhanced to accommodate methods were a playing of,for example, one or a set of segments is played in one instance of aplaying of a video and not in another instance of the playing of a videoby the viewer.

In one method, a playing of one segment may be responsive to whether itis a viewer's first or subsequent playing of the motion picture. Inother words, in addition to establishing explicit or implicit linkagesamong segments, a video map includes segment definitions that are codedin such a manner as to enable playing certain segments on a firstplaying of a video and playing of other segments on a subsequent playingof the video, e.g., a second playing, or any playing following a secondplaying. For this purpose, a video map may assign each multiplay segmentto one or more of a plurality of specific playings, e.g., 1-10.

The Multimedia Player's software may be configured to track multipleplaying for each viewer in, for example, a household, and for allvideos, classes of videos, and/or specific videos.

Alternatively, or additionally, a multiple playing tracking may be setin such a manner as to ensure that all of the segments that may beplayed are played within a viewer selected number of playings. Forexample, a viewer may determine based on the general subject matter of amotion picture that the viewer is likely to play the motion picturethree times. Accordingly, the Multimedia Player's tracking softwarewould cause the playing, for that viewer, of multiplay segments to bespread over the projected three playings. The software would then mergethe multiple play codes into the plurality of desired playing, e.g.segments coded 1-3, would be played in a first playing, segments coded4-6 would be played in a second playing, and segments coded 7-10 wouldbe played in the a third playing.

Still alternatively, or additionally, the tracking software may itselfcode the various segments for the number of projected playings. Thevideo map in this case need only flag segments which may be suitable fora multiplay.

Certain motion pictures may permit the viewer, at any point prior to orafter initiating applying of the video, to force the playing of all thepossible segments and non-mutually exclusive segments. Further, a viewermay decide, after initiating playing the video, to change the number ofprojected playings. In both cases the tracking software would adjust theplaying of the multiplay segments.

Still alternatively, or additionally, segments may be coded with orassociated with a random function to enable playing responsive to, forexample, a number/bit code, assigned to a segment, that is compared fora match with a software extracted or randomly generated number/bit. Therandomness of the playing of multiplay segments may be established withrespect to any number of different probabilities. In the playing ofmotion pictures, at least a 33% probability or preferably a 66%probability that a segment is played has been found to give satisfactoryresults.

Additionally, different probabilities may be established for differentplayings. For example, a playing of a segment may be responsive to a 33%probability in a first playing, a 66% probability in a second playing,and 100% probability in any playing after the second playing. Further,different random settings can be set for, for example, each viewer in ahousehold. For example, a parent may find it advantageous to establishfor small children a low probability preference, and/or set amultiplaying preference that causes the segments to be spread over agreater number of playings.

Thus, independently or in addition to other coding (e.g. violence and/orMPAA rating), segments may be coded for i) a specific playing of thevideo (e.g. the first, second, and/or any subsequent playing after, forexample, the first playing); ii) completely random for each segment;iii) completely random for a set of segments; iv) a combination ofrandom and specific playings; and/or v) other methods, e.g., methodspecific to a video.

Further, the method, behavior and/or inclusion of multiplay segmentsneed not be the same within any given playing of a video, or anysubsequent playing. Segments produced for a subsequent playing need notrequire, when played, the exclusion of the playing of other segments. Asubsequent playing may in fact reward the viewer with the longer versionof a motion picture. As may be required by a specific methodology, thetracking software would cause a retention of the information that may berequired for a subsequent playing.

The objects of multiple playing challenges the filmmaker to accomplishmuch more than providing multiple camera angles. Further, while it mayalso be incorporated, the objects are not, necessarily, to change thestoryline, ending, or the levels of explicitness. Segments may beproduced with the principal purpose, consistent with the artisticpresentation, of introducing freshness to a subsequent playing of thevideo. Examples, are segments that bring an unexpected perspective ortwist to a scene or to the development of a character, and segments thattake the viewer through a detour from, and later rejoin, the primarystoryline.

Multiplay methods may be advantageously incorporated in the playing of,for example, “whodunits”. In such instances, for example, more clues orexplanations may be presented to the viewer by multiplay segments thatemphasize clues or link the importance of events. Often the ending ofthe story requires that an event had taken place, which could not havebeen shown during the initial playing. Multiplay segments may provide anopportunity to show the event taking place (the viewer already knows whodid it) or the possibility of the event taking place. This would, forexample, serve to establish a viewer's credibility for the internallogic of the story.

By contrast to the selection of camera angles in the playing of amultiangle DVD, segments produced for multiple playing purposes may becoded in such a manner as to inhibit the kind of viewer content controlsthat would otherwise permit the viewer to control the playing ofmultiplay segments. Additionally, a playing of one of a set of multiplaysegments, e.g., segments relating to the same scene or event, may bemutually exclusive with a playing of another one of the segments of theset. That is, for example, whether the contents of the set of segmentsare duplicative or inconsistent, the playing of one segment of a setprecludes or inhibits the playing of another segment in the set.

Multiplay segments need not be provided with the original release of thevideo. A video-on-demand environment facilitates supplementing theoriginally released content at such time and under the conditions whichthe producer may find most advantageous. For example, visitors to theproducer's web site may be permitted to download segments that augmentthe enjoyment of a subsequent playing of a video which might have beenprovided in a DVD. In those instances where the multiplay segments areincluded within the video, the segments may be coded in such a manner asto not be playable until, for example, a specified data beyond theinitial release of the video, and/or beyond, for example, a firstplaying of the video.

The steps in the playing of multiplay segments of a variable contentvideo expand upon the steps previously detailed with respect to FIG. 9A,and, depending on the particular embodiment, are incorporated with,and/or added to, the methods of applying a viewer's content preferencesto a video map. Alternatively, or additionally, as shown, in FIG. 9B,the steps in the playing of multiplay segments of a video may beindependent from any other of the capabilities that may be supported bya video map.

Accordingly, with respect to the flow chart of FIG. 9B, in the playingof a video, a video map is read 951 that directly or indirectly, e.g.camera angles or flagged segments, identifies video segments suitablefor the activation of the multiplay function. If multiplay segments areavailable, a multiplay function is activated 952, and an inquiry of atracking of a previous play is made 953. If multiplay segments are notavailable 952, the playing of the video proceeds without the activationof the multiplay function 991.

If the multiplay function is activated 952, and a previous playing ofthe video has been tracked 953, the retrieval of previous playinformation is performed 954. If the video has not been previouslyplayed by that viewer, i.e., tracking information is not available, themultiplay function operates on the basis of it being a first playinginstance of the video 955.

Alternatively to the presumption of a first play 955, and/or as averification of the accuracy of the tracking, the multiplay functioncould cause a direct inquiry of the viewer to ascertain the correct ordesired playing instance 955. For example, the multiplay function couldaccommodate a viewer that may have come to expect that the content ofthe second playing would be preferable to the content of the firstplaying, and would prefer to initially play the video as if it was asecond playing.

The multiplay function then determines if the playing of the video is tobe responsive to the specific play instance 961. In other words, themultiplay function ascertains if, for example, the Multimedia Player hasbeen configured to play the video according to the specific playinstance methodology, a viewer has selected the specific play instancemethodology, or the video itself requires a playing according to thespecific play instance methodology. If the playing of the video is to beresponsive to the specific play instance 961, if not already available,the appropriate segment information or code is obtained from the videomap 962.

In order to determine if a segment or group of segments is to be played,the segment instance code, previously obtained 962, is compared for amatch 964 to the play instance information previously obtained 954/955.Based on the comparison 964, the segment or segments are determined tobe playable 965 in this instance or not playable 966.

If a next segment or group of multiplay segments 967 require a similardetermination of playability, the process is repeated with the readingof the segment code or codes 962 as previously detailed. Otherwise, theplaying of the video begins or other functions required in advance ofthe playing are activated 991. Alternatively, the segment or set ofsegments are played as each play determination 964 is made.

If the playing of the video is not to be responsive to the specific playinstance 961, the multiplay function then determines if the playing ofthe video is to be responsive to the random play methodology 971, and ifso proceed by obtaining a segment code and/or other video mapinformation 972 which may affect the random functions with respect to,for example, the generation of a random code 973, or the availability ofrandom codes, or the particular matching methodology utilized.

In order to determine if the segment or group of segments is to beplayed, the segment code, previously obtained 972, is compared for amatch 974 to the random code generated and/or obtained 973. Based on thecomparison 974, the segment or segments are determined to be playable975 in this instance or not playable 976.

The playing of multiplay segments based on a random play need notrequire matching a random code with a segment code, the random playfunction could generate a random code and if such code matched somepredetermined value the segment would be playable. For example, programroutine implemented would simulate a coin flip, i.e. a On bit or an Offbit, and would determine the segment as playable on the occurrence ofthe On bit. Thus, any suitable method which may provide a random playingmay be instead be implemented for the matching step 974 previouslydetailed.

If a next segment or group of multiplay segments require a similardetermination of playability 977, the process is repeated, if requiredwith the reading of a segment code 972, as previously detailed, and, ifrequired, with the obtaining or generating of a random code 973, aspreviously detailed. Otherwise, the playing of the video begins, orother functions required in advance of the playing are activated 991.Alternatively, the segment or set of segments are played as each playdetermination 974 is made.

It is emphasized that the interplay between play tracking information, asegment random code, other video map information, and an obtained,otherwise extracted, or generated, random code, offers a plurality ofpossible combinations and methods of determining a playing of a segmentor group of segments. For example, alternatively, or additionally, tothe specific play instance methodology 961/964 and the random playmethodology 971/974, an alternate playing method 981 may be implementedthat, for example, is a combination of both of these methodologies,and/or implements, for example, a method particular to, or specificallyprepared with the authoring of the video. An example of a combinationmethodology would be in a first playing, segments relating to thestoryline would be played based on a segment code play instance match964, and segments relating to the action or violent scenes would beplayed based on a random determination 974.

The simplified flow chart of FIG. 9B only shows some of theconfigurations that the permutations and/or various combinations of thespecific methods and elements make possible. The particular arrangementof steps and/or labeling utilized in the flow chart are to be understoodas suggestive of the detailed disclosure herein.

Further, while the playing of multiplay segments of a video has beendetailed with respect to methods which are independent of the playing ofanother video, an alternative method makes the playing of multiplaysegments of a video dependent on how, and/or which of, the multiplaysegments of another video were played. This particular embodiment offerscreative possibilities in the playing of a video which, for example, isrelated to, or is a sequel of, a first played video. For example, theplaying of a segment in a subsequent video which further expands on thedevelopment of a scene would be conditioned on the playing of amultiplay segment of a first video which introduced the development ofthat particular scene.

As suggested previously, the capabilities of a Multimedia Player areparticularly well suited for providing a supervisor (i.e. parent)complete control as to the video material to which a viewer/player (i.e.child) is exposed. As indicated above, a Multimedia Player provides:viewer, time of day, amount of viewing controls; and individualpreferences for each viewer/player or class of viewers/players. Theteachings of U.S. Pat. No. 5,550,575, titled “Viewer DiscretionTelevision Program Control System”, is incorporated herein by reference.

Additionally, supplementary or alternative routines are provided forthose instances where: i) segments cannot be rated according tostandardized descriptive structures; ii) the utilization of adescriptive structure system is not desired; or iii) a simpler routineprovides the desired functionality. Specifically, routines permits asupervisor to automatically select segments of a video previouslyidentified in a video map as providing material which may not besuitable for a viewer (e.g. flagged segments or PG-13 segments); viewingthe selected segments and determining their suitability for viewing bythe viewer; automatically generating a segment table responsive to thesegment suitability determination and the video map; automaticallyretrieving segments responsive to said segment table; and automaticallytransmitting the retrieved segments as a continuous video for saidviewer.

An example of the editing routines that provide for the efficientpreviewing of flagged segments are summarized with respect to FIG. 10.One of a number of setup routines present a listing of viewers overwhich the supervisor has supervisory control. With respect to eachviewer and the selected video, the listing indicates if a segment tableis already available 1001, and if viewer preferences are available 1002or not 1003. Additionally, the option to designate a new viewer 1004 ismade available to the supervisor.

If a corresponding table for the desired viewer is available 1001 andthe supervisor does not wish to make any changes, selecting this optionexits the routine, and the operation of the Multimedia Player is thenpermitted as detailed previously. If a corresponding table for theselected viewer is not available, and the supervisor does not wish tocreate or update the viewer's preferences 1002, the routine proceeds byreading the video map 1021. If the supervisor wishes to modify or createviewer preferences 1003, the routine proceeds with the appropriateroutines 1012. If the supervisor indicates the entry of a new viewer1004, the appropriate viewer entry routines are enabled 1009, and theopportunity to create viewer preferences for the new viewer is provided1011.

The routines to update/create new preferences 1012 permit both a videospecific or permanent updating of the selected viewer's preferences.Once viewer preferences are indicated, if any, the selected video'svideo map is read 1021 and compared to the preferences 1022 to theextent that they are available.

If all the flagged segments are effectively excluded by the viewerpreferences 1022, the resulting video segment table is saved 1041 andthe routine is exited. Otherwise, in addition to an initial segmenttable, a list is prepared 1023 consisting of any flagged segments thathave a descriptive level inconsistent with the corresponding level inthe preferences, and flagged segments for which there is nocorresponding preferences. In the absence of a viewer's contentpreferences every flagged segment is included in the segment list.

In a manner similar to the retrieval of non-sequential segments outlinedpreviously, only the segments in the segment list are shown one afterthe other 1031 as a continuous stream to the supervisor, pausing only ifan include/exclude decision is not indicated 1032. The processcontinuing automatically 1034 until a decision on each of the flaggedsegments in the list is made 1032. As each decision is made the segmenttable is updated 1033. Alternatively, the segment table is updated andsaved following the transmission of the last segment 1041.

Each segment need not be viewed in its entirety 1031. As soon as aninclude decision is made 1032, the showing of the next segment beginsinstantaneously.

A showing of a flagged segment is not limited to the actual transmissionof the flagged segment's video/audio. Appreciating that certain adultsmay not be interested in viewing the flagged segments, a characterdescription of the contents of the segment may be provided instead or inadvance of the option to view the corresponding segment.

The above is presented to emphasize control features and capabilities,and that particular routines shown can be enhanced in a number of ways.Configuration routines are contemplated that further facilitate andautomate viewer/player controls. For example, a configuration can beselected that automatically creates for selected or new viewers/playersa segment table excluding all flagged segments. In this case, at systemsetup, a viewer is simply associated with the exclusion of all flaggedsegments.

Similarly, alternatively, or additionally, at system setup, a viewerrecord and/or Multimedia Player is associated with an appropriatedescriptor, e.g., rating code, thereafter, the viewing/playing of avideo is consistent with the established preference. The simplicity ofthis method in combination with the teachings of the variable contentvideo permits, for example, by means of a single code associated witheach viewer, a parent to view an “R” version of a film, and permits achild to view a “G” version of the same film. It is noted that thisarchitecture provides more tailored control than the simpler exclude allflagged segments architecture, but significantly less customized controlthan a category specific video content preferences.

In a preferred embodiment, the various coding and descriptive schemesand structures detailed above are correlated to permit the applicationof a variety of content control options without requiring duplicatingcoding definitions. For example, assigning a segment a code other than a“G” code is equivalent to flagging the segment.

As detailed herein, it should be recognized that content preferences ingeneral, and preferences for a content level in each of a plurality ofcontent categories, in particular, are utilizable both in the selectionof a video and/or in the selection of a version or customization of aselected video. The teachings of U.S. Pat. No. 5,410,344, titled“Apparatus and Method of Selecting Video Programs Based on Viewer'sPreferences, and of U.S. Pat. No. 5,678,012, titled “Method and Systemfor Selecting a Video Piece From a Database”, are incorporated herein byreference.

A Multimedia Player's capability to obtain videos from a remote videoprovider permits an end user to efficiently obtain, from an extensivevideobase, a video(s), segment(s) of a video, and/or segment(s) fromeach of a plurality of videos, to be viewed at the time of the user'schoosing, over which the user exercises complete control as to thesubject matter, form of expression, and other elements comprising thevideo. Further, the resulting video need not comprise or result from asingle videobase. A video may result from the automated selection of avariety of segments/videos from one or a plurality of videobases.

Accordingly, for example, a user wishing to retrieve a summary,analysis, and background regarding a particular news event, will enterhis/her request, and a keyword analysis of the request will then resultin an on-line linkage through the service center to a databasecontaining information on the videobases for the subject matter desired.In this example, a news source remotely located, will download a listingof the various sources of summary, analysis, background information, thecorresponding video maps where available and necessary, and the overalllengths and costs, if any, of each segment. Based on this listing, theuser may at his/her leisure produce a request for a video for his/herown viewing. In this example, a video comprising a 10 min. summary froma news source, a 5 min. analysis from another service, a 10 min.analysis from a private source, a 30 minute lecture from a university,and copies of a relevant data from the Library of Congress arerequested.

Once the user finalizes the video segment choices, the request istransmitted to the service center, wherein the various providers(libraries) which may be located anywhere in the world areelectronically requested to transmit the respective segments/programs,video maps, and any user routines. These are logically assembled andmerged by the service center and retransmitted to the user together withany billing information. The transmission and retransmission of thevideos might be on a non-realtime compressed digitized format.

The event duration in this example may be 15 minutes of connect time, 2minutes of transmission time (for the 55 minute “video”). The costs forthe service may be less than a conventional movie, and may include apartial rebate for the user selection to activate the five minutes oftargeted “advertisements” that are included. The particular billingmethods and apparatus required are currently implemented in otheron-line data retrieval services.

Since a Multimedia Player may be both a retriever and a transmitter, theabove “video” might be condensed by the user into a 10 minute summaryand a 2 minute personal message and transmitted to another user,incurring where applicable connect time and redistribution charges.

In another example, a user may construct a content preference structureof any desired detail, further including, for example, a variety ofkeywords to describe the video's subject matter, content preferences,the story line, possible endings, and approximate video playing time.The user will transmit this information to a video provider. The userwill further indicate the video's delivery by requirement (minutes,overnight, days), and whether the request is for a single video or aseries of videos, and their frequency.

The video provider will analyze the user request, and search thevideobase for a video matching the user's requirements. If the video isfound, then video information, and billing, if any, are transmitted tothe user for approval and subsequent video transmission to the user. Thevideo information transmitted to the viewer may include, for example, alist of the videos that are responsive to the viewer's contentpreferences and subject matter and/or programming preferences, as wellas detailed descriptions including the amount, percentages, times, andother quantitative and qualitative information regarding the content ofeach of a plurality of content categories. The information provided theviewer may also include, for example, the theatrical trailers, as wellas linkages to web sites/pages that may provide additional information.

If the video is not found, the user's request is forwarded to anappropriate video producer for possible production. The “custom” videosgenerally follow a preestablished per transmitted viewable minute feestructure based on the subject matter and nature of the video.

Conversely, a producer, rather than following conventional practices forraising finding for the productions of a video, may elect instead to theplace a video project's synopsis and other information, (e.g.,directors, actors,) normally made available to prospective purchasersand/or investors, directly before a potential audience. When sufficientpay-per-view or other viewer commitments have been accumulated, and tothe extent necessary, verified at the appropriate time, then the projectcan be directly financed by the viewer's or indirectly financed by alending institution that would advance the necessary funds.

As in the case of conventional investors, the funding public may also begiven an opportunity to participate in any profits that may begenerated. Further, since a significant amount of time is required fromfunding to delivery of the video, the viewer's interest may bemaintained and enhanced by periodic appraisals, and delivery of “filmingof” vignettes, actor appearances, etc. that would serve to bond thepublic's interest to the production.

Although other schemes are possible, production inevitably depends on anexpected or actual critical mass of viewers and any sponsorship, bothpublic and private, that may be associated with a video project. Thevarious network systems herein suggested facilitate the communicationand marketing required to obtain the necessary viewers and sponsorshipfor the production of a video.

Examples of the variety of uses of such video production servicesinclude: i) science fiction enthusiasts sponsoring a production of aparticular story, i.e., a 21st century version of “Romeo and Juliet”;ii) viewer consensus selecting the character and theme for a sequel to avideo that they have viewed; iii) updating of news stories no longerdeemed “current”; iv) continued appraisal of developments in a specifiedfield or subject area, i.e. significant events which might affect theprice of a specified commodity; v) review of a political candidatespositions; and vi) product purchasing and utilization information.

In a video-on-demand environment, typically, viewer's will request thedelivery of specific pre-produced variable content videos. In additionto the other method disclosed herein a video may be obtained by, forexample,: i) specifying the video's title or code obtained from areference guide; ii) making a selection from a listing in alphabeticalorder by title, subject matter, actors, etc.; iii) tree structure ofvideo classifications, for example advertisements, automobiles, 4WD; iv)keyword searching and retrieval (similar to the Automated Patent Searchimplementation); v) specifying preferences for a content level in eachof a plurality of content categories; and vi) any combination of these.It is noted that a reference guide may be available in a printed formator, preferable, a real-time format compatible with a Multimedia Player,e.g. retrieved from a Web site.

In the event that a match between a viewer's content requirements is notexactly satisfied by the available videos, the search software may, atthe viewer's option or by default, reduce or eliminate content criteriato provide a listing or selection of videos that approximate as close aspossible the viewer's requirements. For example, assuming that aviewer's request comprises, among other content requirements that amotion picture include graphic sexuality and a high level of suspenseand humor, and that no such motion picture is found. Than the videoprovider's videobase search software could lower the level of sexualityto explicit, and search on that basis. The search could alternatively,or in addition, lower the level of suspense to a medium level. On thisbasis the viewer is than presented with a listing of the availablemotion pictures at each of the adjusted combination of requirements.

A listing of available videos could be in a form similar to thatprovided by an Altavista web search, with links to home pages and/orlinks that would play, for example, the theatrical trailer (773 FIG.7E).

Once a video is selected, the entire variable content video, includingall the parallel and transitional segments and the video map, may betransmitted to the user's Multimedia Player. When the video map is notdownloaded, a video is transmitted that results from the application ofthe viewer's video content preferences to the video map of the requestedvideo. That is, only a logical seamless sequence of only those segmentsthat are consistent with a viewer's content preferences are transmittedin a real-time or a non real-time format over the network to aMultimedia Player for display on a TV. For example, when the videoprovider utilized a DVD having two versions, and the viewer has selectedone of the versions, only the segments consistent with the selectedversion are transmitted to the Multimedia Player.

In those instances where the entirety of a variable content video isdownloaded, the Multimedia Player need not store all of the segments,and if all of the segments are stored, they need not all be stored formore than a transitory time, i.e., the time for a user to desire theerasure of undesired content. A video map provides the information toomit the initial storage or to erase, the storage of content of thevideo. This would be of particular benefit for, for example, a parentdownloading an “R” motion picture, and after viewing it, causing theerasure of those segments which are inconsistent with a “PG” version. Orfor example, a viewer causing only a selected story or segment from anews program or video magazine to be saved.

A significant advantage of the partial erasure of content is thatstorage capacity is freed for a subsequent use. With the furtheradvantage of a random access medium, such as DVD-RW, new content can beadded to the unused sectors or areas, without necessarily rewritingsaved content. The operation being similar to the storage of data in themagnetic drive of a PC. In such instances, the original video maps maybe retained and/or incorporated within a master index of the contents ofthe storage device.

To ensure the usefulness of a video map and any service associated withthe delivery of a video map, the video map may be, for example,encrypted, and other security methods may be implemented to verify theorigin, authoring, and/or integrity of the video map. Additionally, theoperation of the Multimedia Player's software may be dependent on thevalidation of the video map. In other words, in those instances wherethe source and/or integrity of the video map cannot be verified by thePlayer's software, the video is not played. In such instances, theplayer may create a failure record accessible, under password control,by the Player's administrator, e. g., a parent. Similar methods may beapplied to a viewer's content preferences.

Utilization of the video need not await the completion of thedownloading. The viewer can begin viewing the video in real-time whilethe video is being downloaded in real-time or non-realtime (burstdownloading). Further, the downloading of the video need not beaccomplished in one session. Short burst downloading will provide aportion of the video. As that portion is utilized control software willrelink the Multimedia Player with the video provider, request andreceive a next portion, and disconnect the active linkage. During thisoperation, automatic and transparent to the user, a constanttransmission of the video is maintained. In instances where aparticularly popular video in continually available on the network, theMultimedia Player may “catch” segments as required.

Short burst downloading is advantageous where the storage capacity ofMultimedia Player is insufficient for the storage of the complete video.Short burst downloading is also, for example, advantageous where a videoprovider's resources are challenged by a plurality of end users. Byutilizing short burst downloading and overlaps, a single video stream isable to serve a plurality of end users simultaneously. The control logicof this architecture is analogous to that utilized by single waiterserving a plurality of parties (tables) in a restaurant.

Alternative to a Multimedia Player initiating the re-linkage with thevideo services provider, the control logic of the video serverperiodically checks on the progress of the end users, downloading andscheduling subsequent transmissions responsive to each end users needsand the overall demand on the available resources.

Alternatively to the downloading a video, the end user remains on-linewith the video provider during the transmission of the video andutilizes the hardware resources of the video provider. In an on-linearchitecture, a Multimedia Player comprising principally communicationscapabilities without significant local storage, processing, or memory,is adequate. In such an architecture, a viewer's content preferences, ifnot stored in the Multimedia Player, may be retained by the videoprovider.

The off-site video server will respond to the user's commands in amanner similar to that detailed previously for the video disc playerimplementation. The viewer's control over the video, such as for examplepause and skip functions, are the same, whether a Multimedia Playerretrieves a video from a remote or a local source, e.g. a DVD.

FIG. 11 is a flow chart further detailing the steps of retrieving avariable content video from a video services provider. It is noted thathandshaking and other routines are flexible and user configurable and anumber of permutations and variations of what is detailed are possible.

In operation, Multimedia Player normally provides a variety ofcommunication and background services (e.g. videophone, video fax,security, appliance management) to the user and therefore is ready torespond to an user command 1101. Upon receipt of an user command, aMultimedia Player provides power to a display unit (TV) if necessary,and transmits an appropriate acknowledgment 1102.

Access routines previously detailed with respect to FIG. 9A steps903-909 are here shown in FIG. 11 as block 1103. In a preferredembodiment, these routines reside within a Multimedia Player and areexecuted prior to establishing a communications linkage with either anetwork administrator or directly with a video services provider.

If access is denied 1103, an error message 1104 is provided to thedisplay and the Multimedia Player is returned to the state prior to theuser active request. Delay routines may be implemented to provide theuser the opportunity to attempt to obtain access without a MultimediaPlayer going to “sleep”.

If access is permitted 1103, retrieval routines are enabled 1105 topermit the remote retrieval of a video. It is noted that in the case ofthe video dialtone model, there may be a multistage retrieval routine1110 when the viewer first establishes communications with the networkadministrator 1111, for example a cable or telephone company, thenselects a particular video services provider 1112, and then request thedesired video 1120. Alternatively, retrieval routines 1114 permit adirect selection of a video services provider 1112. Video selection 1120then proceeds on-line with the selected video provider. A video servicesprovider can be preestablished as in the selection of a long distancecommunications carrier. In that case, the viewer would skip having toselect a services provider immediately prior to a video request.Further, a viewer may establish relationships with specific videoproviders for specified services.

Still further, a video selection process 1121 itself may determine withwhich provider a communications linkage is automatically established1122. The result of the video selection process is automaticallytransferred 1123 to the appropriate provider upon the establishment of acommunications linkage. Clearly, the selection of a video servicesprovider is not required in those instances where a viewer obtains allthe services from a single provider, and no escape mechanism (e.g.,selection of alternate long distance telephone carrier) is provided.

It is noted that other combinations are possible and that retrievalroutines may reside within a Multimedia Player to further minimize theon-line time, or be provided on-line at different points in thecommunications than shown here. The video selection process mayimplement any one or more routines that are suggested by the examplesherein provided.

Once a video is selected, if the viewer remains on-line during theviewing of the video 1130, the viewer's content preferences arecommunicated to the video provider 1131. The video provider server thenapplies the viewer's content preferences to the map of the selectedvideo 1132 and provides the resulting seamless and continuous version ofthe video that is consistent with the viewer's content preferences 1139.In this case the viewer remains on-line during the viewing of thecustomized video 1139, but has access to video viewing control functionsas if the video was directly available to the Multimedia Player.

Alternatively, the entire variable content video, including all theparallel, overlapping, and transitional segments, and the video map, areretrieved from the video provider 1134. Utilization of the videodownloaded to the Multimedia Player is then the same as previouslydetailed with respect to FIG. 9, and FIG. 10. Principally, the viewer'sMultimedia Player applies the viewer's content preferences to the map ofthe selected video 1135 and provides a seamless and continuous versionof the video that is consistent with the viewer's content preferences1139. In this case the viewer has direct access to the MultimediaPlayer's video viewing control functions. Whether only the resultingversion of the video is downloaded, or the entire video, including thevideo map, the viewer may interact with the video to the degree that theviewer desires.

If Multimedia Player is off-line and the interaction requires additionalvideo from the video services provider, the Multimedia Playerautomatically reestablishes communications with the appropriate videoservices provider and brings the video server up to speed. That is, theMultimedia Player automatically provides the required information toenable the video server to comply with the viewer's requirements.

It is intended that interactive capabilities that are taught byinteractive and multimedia systems are provided the user of a MultimediaPlayer. A number of other interactive capabilities are made possible bythe random access capabilities of a Multimedia Player in combinationwith the content-on-demand architecture.

With the proliferation of large size high definition display means, aviewer may desire to retrieve and/or play a video that converts, forexample, a wall mounted display unit into a “window” to a remotelocation. For example, a DVD or broadcast could provide an hour of aseaside view, recorded by, for example, a fixed and/or slowly panningcamera, that provides a viewer with the desired looking out of a windowexperience. Where multiple display are available, within a room, or inseparate rooms, the display set could present a coordinated set ofmultiple virtual windows creating a surround visual field.

The motion in the video here is characterized by the natural movementswithin the scene, and distinguished from the content of, for example,nature programming, by the lack of shifts in cameras and an explicitstoryline. Further, the primary object as in the case of “mood”soundtracks is to create a natural visual/audio mood, field, and orvirtual window. Particularly, in the case of a non-realtime video, thevideo and video map may be authored to provide an endlessly andseamlessly looping presentation. The video map could also provide theinformation required to time compress or expand the length of a scene

Other example of different mood, window, or setting videos include:moonlight, falling snow, tempest, sunset, marina, skyline, fireplace,sidewalk cafe. Particularly with the later example, the viewer couldselect among a plurality of locations, e.g. Paris, times of day,activity level and so on. Virtual windows need not be limited to naturalsettings or be non-moving. For example, a video may provide afunctionalized computer generated window view from that of an exploringspace vehicle.

Responsive to a viewer's content preferences, the natural sounds of ascene may be enhanced; supplemented by, for example, music; and/orfiltered to exclude, for example, excessive traffic sounds.

The previously shown capacity to read/write the viewer preferences fromand to an user access media provides a viewer the means to automaticallyconfigure a Multimedia Player that had not previously learned theviewer's video content preferences (dumb Multimedia Player).

Referring once more to FIG. 4, in anticipation of the desire toefficiently utilize a dumb Multimedia Player 432, a viewer instructs thesmart Multimedia Player 431 to download to the viewer's user accessmedia 144 the desired content preferences and video request routines. Toautomatically configure the dumb Multimedia Player 432 and retrieve avideo consistent with the content preferences and video requestroutines, the viewer provides the prepared use access media 144 to thedumb Multimedia Player 432, or to an accessory device housing a compactportable storage subsystem 105 and in communication with the dumbMultimedia Player 432. The user access media 144 automaticallyconfigures the dumb Multimedia Player 432 without necessarilydownloading the viewer's content preferences other than to volatilememory. This operation is similar to moving a game cartridge from afirst game player to a second game player.

Transporting the video request routines facilitates the process ofautomating the retrieval of desired video from a video provider 411 bythe use of any Multimedia Player 432 that may be available to a viewer.In this fashion, for example, a traveling executive can automaticallyconfigure a Multimedia Player in a hotel room to retrieve videophonemessages, the day's news in a format and for topics preestablished bythe executive, followed by a menu of recently released films that theexecutive has not seen. The operation being analogous to inserting anaccess card in a hotel room door.

It should be appreciated that a viewer establishes an unparalleleddetailed profile of the viewer's video preferences and contentpreferences. Accordingly, to address the privacy concerns, theautoconfiguring means permit a plurality of users to efficientlyautoconfigure a single Multimedia Player without leaving behind thevideo content preferences.

Similarly, a parent may provide a child a user access media containingthe child's content preferences to ensure that while the child is at asecond location or household, the child is not exposed to video materialthat is not deemed suitable by the child's parent. The Multimedia Playerat the second location may compare the content preferences in the useraccess media with resident applicable content preferences and report anyconflicts or automatically resolve the conflicts. For example, avisiting child's content preferences may provide for more explicitmaterial than the second parent would find suitable for their child. Insuch an instance, the Multimedia Player would adopt among theconflicting preferences the less explicit content preference in eachcategory.

A similar automated configuration may be performed by means of thenetworks communications capabilities that may be available to both thedumb Multimedia Player 432 and the smart Multimedia Player 431. Thisparticular embodiment may or may not include the utilization of anuser's access card.

In an RCA RC5200P DVD player, the infrared remote control comprises thefollowing keys/buttons: ANGLE, AUDIO, SUBTITLE, ON-OFF (subtitleon/off), SKIP REV, REV, and PLAY. In a situation where the viewer didnot understand the dialogue of a segment of a motion picture, the viewerwould have to, for example: i) press the subtitle ON-OFF button to turnon the subtitle; ii) press the SKIP REV button to skip backwards to thebeginning of the current chapter; and iii) following the replaying ofthe segment, press the subtitle ON-OFF button to turn off the subtitledisplay. Alternatively, the viewer could: i) press the subtitle ON-OFFbutton to turn on the subtitle; ii) press the REV button to rewind thevideo to the appropriate point; iii) press the PLAY button to stop therewinding of the video and cause the video to play the segment; and iv)following the replaying of the segment, press the subtitle ON-OFF buttonto turn off the subtitle display.

The common problems with both of these methods are: i) the number ofsteps that are required; ii) the video is likely to be rewindedsubstantially past the amount usually desired in a significantpercentage of the cases; and iii) the loss of attention to the playingof the video required to turn off the subtitle display. In the case ofutilizing the SKIP REV button, the excessive rewinding problem resultsfrom the fact that the SKIP REV function is controlled by segmentdefinitions (chapters) averaging three to four minutes in duration. Inthe case of utilizing the REV button, the excessive rewinding problemresults from the velocity of the rewinding function in a DVD player.

In view of the foregoing and other shortcomings of the prior art, it isan object to enhance the viewing of a video by providing an elegantmeans and method for replaying for a viewer a non-understood segment ofthe video. Accordingly, a Multimedia Player's software is enhanced toserve those situations in which a viewer has failed to understand thedialogue, i.e. “What was said?”.

A remote control capable of activating a replay function comprises aWHAT? button, key, or other replay function key or means, to enable aviewer by activating the replay function to automatically cause thesystem to: i) rewind or skip backwards the playing of the video a systemdefault or a viewer specific previously defined amount, e.g. 20 seconds;ii) turn on the subtitle to a system default or a viewer specificpreviously selected subtitle language, e.g. English; iii) turn off thesubtitle at either the point the WHAT? button was pressed or at someviewer specific previously defined point with respect to the time atwhich the WHAT? button was pressed, e.g. five seconds prior to, orafter, the point the WHAT? button was pressed; and iv) increase theaudio/dialog volume during the segment replayed.

Thus, advantageously, by, for example, the pressing of a single WHAT?button or issuing, a single word command, a viewer accomplishes afunction which cannot be accomplished, as efficiently and elegantly,with the pressing of at least three buttons in, for example, theoperation of the RCA RC5200P DVD player.

A viewer may activate the replay function in a Multimedia Player(100FIG. 1) by, for example, pressing the WHAT? key (289FIG. 2) on aremote control (200 FIG. 2), a WHAT? function key in a personal computerkeyboard, a mouse click on a WHAT? button on a monitor display (311 FIG.3), or a voice command comprising the verbalization, speaking, orpronouncement of, for example, the word “What”. Various skipping backcapabilities and functions may be activated by the WHAT? key, otherdedicated keys, e.g., REP (Replay) key, or by keys, e.g., the SKIP REVkey, which may serve a plurality of functions depending on theparticular player activity. The replay capabilities may, at the optionof the viewer, supplement or replace the conventional functions of, forexample, the REV key.

FIG. 12 is a flow chart of a method of replaying a segment of a videowith supplementary information. When, during a playing of a video 1200,the Multimedia Player's processing software receives, by means of a userinterface means, e.g., a remote control or voice response system andassociated Multimedia Player components and software, a request toreplay a part of the video 1201, a replay function, e.g., the What?function, is activated. The activation of the replay function causes theMultimedia Player's processing to store 1202 the time, frame position,or some other indicator of the place, location, or position (“requestposition”) of the video in which the replay request was received in amemory means, e.g., RAM, or other electronic, magnetic, or optical meanssuitable for storing request position data (see detailed descriptionwith respect to FIG. 1).

If a viewer's preestablished replay preference, such as, a viewer'sspecific previously defined amount, e.g. 30 seconds has been established1211, the Multimedia Player sets the rewinding or skipping backwards(“skipping back” or “skipping”) of the playing of the video by theviewer preestablished amount 1212. Otherwise, the Multimedia Player setsthe skipping of the playing of the video to a system preestablishedreplay preference 1213, e.g., a default amount such as 35 seconds.Herein, whether a viewer's replay preference or a system's replaypreference, preestablished means that the amount replayed is notdependent on a viewer's action at the time of the replay request.Preestablished does not necessarily mean that the replay preference isnot responsive to the particular segment played.

In those instance that the playing of the video is voice controlled,separate default values may be established to reflect the fact thatviewer's may be more likely to say What? faster than to be able to pressthe What? button.

A skipping back is responsive to the particular capability of thehardware's and/or a system's random accessing means, and/or a viewerpreviously defined preference. In certain embodiments, e.g., electronicmemory, a “skipping back” comprises randomly accessing a physicalposition which may be, for example, forwards, sideways, and/or belowfrom the present position. Further, while a Multimedia Player's randomaccessing means may be capable of instantaneously skipping backwards toa previous position in the video, a viewer may, nonetheless, prefer thatthe replay comprise a rewinding of the video at a viewer specified rate.Herein, the term “skipping” ought to be understood in the broadestsense, and as comprising rewinding and skipping backwards capabilitiesand functions, e.g., time and/or segment information based, theselection of which, and operation, being responsive to a system's and/ora viewer's defined preference.

The rewinding of the video is cumulative responsive to multiplesuccessive activation of the What? function, e.g., a contemporaneoussubsequent replay request 1214. For example, if the viewer has pressedthe What? button in the remote control twice within a substantiallysimultaneous time, e.g., two seconds, the Multimedia Player would causethe skip back position or amount to be augmented 1215 to 60 seconds,i.e. twice the viewer specific previously defined amount of 30 seconds.In other words, the distance or time that is replayed is increased bythe addition 1215 of the amount required for a single replay request foreach contemporaneously received successive replay request 1214.

In the event that during an active replay function, but after asubstantially simultaneous time, a new replay request is received, thenthe initial replay request is terminated, and the new replay request isexecuted responsive to the new request's request position.

A request position and/or a replay position may advantageously beresponsive to a previously defined amount in the context of, or adjustedby, a video map or other available segment information 1216 identifyinga logical or appropriate location in the video, e.g., chapter stops,scene definitions, and/or beginning segment information. For example, ifthe viewer specific previously defined amount of time for a replayposition is 25 seconds, but the beginning of the segment, as defined bythe video map or chapter definitions, is at 24 seconds in one instanceand 28 seconds in a second instance, the skipping back takes inconsideration this information and adjusts 1217 the skipping back to the24 seconds or 28 seconds points respectively (beginning of segment orchapter) instead of the 25 seconds point.

Further the adjustment of the request position and/or the replayposition according to segment information may advantageously beresponsive to, or be subject to, a previously override range. e.g. twoseconds. For example, in the case of the previous example, and with thetwo second override range, the replay position would be adjusted to the24 second point in the first instance, but would not be adjusted to the28 second point in the second instance (remains at 25 seconds). Theoverride range need not be equal in both directions. In other words,subject to a viewer's preference and/or system default, the segmentinformation may increase the amount replayed, but not decrease it.

In a preferred embodiment, rather than a viewer configuring the systemat the time of installation or a first playing, a Multimedia Player'sautoactive software routines would learn the viewer's preferences fromthe viewer's actions, and adjust the various settings accordingly. Forexample, with respect to the replay functions, if the logging of theviewer's actions indicate a disproportionate number of contemporaneoussubsequent replay requests, the systems replay point is increased,depending on the amount presently defined, by, for example, fiftypercent.

It should be appreciated that, in particular, time-based skipping backcontrols are responsive to the actual playing time of the particularversion being played. For example, a skipping back of 20 seconds mayactually skip the video stream three minutes, i.e., two minutes and 40seconds is content which is not being played at this time for thisviewer, such as non-selected interleaved camera angles.

Alternatively, or additionally, the skipping back control is directlyresponsive to the video map's segment definitions. In order to addressthe requirements of the various objects herein identified, the segmentdefinitions are likely to be, in many instances, of a shorter durationthan the chapter definitions. Further, the video map's segmentsdefinitions may be specifically augmented to address the replay functionrequirements.

Since a video map's control of the skipping back is dependent on theparticular level of the authoring of a video map, it is advantageousthat the map communicate the fact that it is authored in a mannerresponsive to the replay function. That information would enable theMultimedia Player's processing software to either apply the viewer'spreference for this type of skipping back control, or default to, forexample, the time-based types of controls.

The position at which the supplementary information is discontinued,e.g., turned off, may be responsive to, for example,: i) the point thereplay function was activated, e.g., the replay request was received;ii) the point the replay function was activated adjusted by a viewerspecific previously defined amount with respect to, for example, thepoint of the replay request; iii) the point the replay function wasactivated adjusted by a viewer specific previously defined amount, andfurther adjusted by segment information; iv) the point the replayfunction was activated adjusted by a system defined amount; v) the pointthe replay function was activated adjusted by a system defined amount,and further adjusted by segment information; or vi) the point the replayfunction was activated adjusted by segment information.

With respect to FIG. 12, if the a viewer has specified an amount withrespect to, for example, the point of the replay request at which thesupplementary information should be discontinued 1221, the position atwhich the supplementary information is turned off is adjustedaccordingly 1222. A viewer may specify a time required for the viewer toactivate the replay function and desire that this time be taken intoaccount so that the point at which the supplementary information isturned off occurs at a point in the video prior to the time the replayrequest occurred. Alternatively, if the viewer has not specified anadjustment amount for turning off the playing of supplementaryinformation 1221, the position at which the supplementary information isdiscontinued may be adjusted by system specified amount 1223. In bothcases, responsive to segment information and a viewer's preferences1224, the position at which the supplementary information is turned offmay be further adjusted responsive to segment information 1225.

Alternatively, or additionally, the replay position and the position atwhich the supplementary information is discontinued, e.g., terminationposition, may be responsive to the subtitle information and the displayduration that it requires. That is, the subtitle track is analyzed forlogical beginning points to the dialogue within the various scenes, andappropriate points are identified if not previously defined. Further,for example, in a playing of data having a navigation data structuresimilar to that of a DVD, the data search information, the presentationcontrol information, and/or, for example, the subtitle information,could provide non-interfering information delineating sentences, and/orthe equivalent of paragraphs, e.g., portions of a scene. Thus, to theextent that the video map can provide segment information useful in theestablishing of an appropriate replay position and a terminationposition adjusted to the beginning and end of a scene or completeportions within a scene, the replay will be more natural, elegant,and/or pleasing.

Herein, the enabling and/or playing of “supplementary information” oughtto be understood as the enabling and/or playing, by a hardware,firmware, and/or software processing, of a display, presentation, and/orplaying of subtitles, closed captioning, text, or other textual, video,and/or audio information that may supplement, complement, theinformation being played, and/or substitute, the audio dialogue and/orsegment of a video. Further, supplementary information is anyinformation, e.g. subtitles, data, and/or bits which may be utilized toelucidate, illuminate, illustrate, clarify, and/or explain, during areplay, a portion of a video, and/or may be advantageously utilized in areplay of a segment of a video. Wherever the term “subtitles” appearsherein, it ought to be understood to mean, and be an example of,supplementary information. Alternatively, or additionally, responsive toa viewer's preference, a playing of supplementary information consistsof, or comprises, increasing the audio volume, and/or, for example,increasing the dialog audio absolutely and/or relatively to thebackground audio during a replaying of a segment. Still alternatively,or additionally, responsive to a viewer's preference, in those instanceswhere the segment to be replayed is one of a set of presentationssegments, as further detailed herein, a playing of supplementaryinformation consists of, or comprises, substituting the segment thatwould have been replayed with a playing of an appropriate fragment orsegment from the same set of presentation segments.

Once a skipping back replay position has been established 1216/1217, theplaying of the video is skipped back, by means of, for example, a randomaccessing, to the replay position 1231.

Responsive to a viewer's preference 1241, the replay function need notcause a playing of supplementary information. In other words, theteachings herein may be implemented in the absence of a playing ofsupplementary information, such as a display of the subtitle. Forexample, responsive to a preestablished preference or the authoring ofthe video, the activation of the replay function does not replay thevideo with the subtitles turned on. The replay function may simplyreplay the segment without enabling and/or playing any supplementaryinformation 1243, e.g., turning on the subtitles. Herein, “enabling” isany action or actions, including enabling, turning on, and/or playing,which may serve the object of presenting supplementary information in areplay of at least a portion of a video.

If supplementary information is required and available 1241, the replayfunctions will ascertain if a preference for the type and manner ofdisplay of the supplementary information has been established for or bythe viewer 1242. If this is the case, then the playing of thesupplementary information is configured to be responsive to the viewer'spreferences 1243. For example, for a viewer that has previouslyspecified a preferred subtitle language 1242, e.g. English as opposed toSpanish, the Multimedia Player would turn on the playing of the viewerspreferred subtitle 1243.

It does not necessarily follow that the language that a viewer mayprefer to have the subtitles displayed in will be the same as the audiolanguage that the viewer has selected for the playing of the video. Forexample, while a viewer may be proficient enough and desire to play amotion picture in English, there may be those occasions when thedialogue was heard but the meaning of a word or phrase was not known.Such a viewer may prefer that the replay provide the subtitles in adifferent language, e.g., Spanish, than the language of the audio.Additionally, the viewer may prefer that the audio language besubstituted with the Spanish language audio during the replay.Alternatively, the replay function may replay the segment with onlychanging the audio language. For example, a viewer who customarily viewsa motion picture in one language may desire to replay certain key scenesin a second language.

These and other options may result from a broad range of preferences foreach of a plurality of viewers, as well as the particular requirements,functions, and/or system controls that may be implemented in a video.The use of a voice response control system enables a viewer to specifythe replay options at the time of the replay request. For example, aviewer may for example, command: “Replay”, “Replay 30 seconds”, “Replay50 in Spanish”, or any other command combining functions and options tosuit a particular situation. Further, advantageously, the voice responsesystem would enable issuing commands for other of the functions hereindetailed alone or in combination with a replay request, e.g., “Replay 2minutes close-up French and loop”.

In the absence of a viewer preference for the playing of supplementaryinformation 1241, the Multimedia Player turns on a playing of thesupplementary information responsive to, for example, a system defaultsubtitle language or responsive to a subtitle language corresponding tothe language of the version of the video being played 1244.

The turning on and display of the subtitles is one example ofsupplementary information which may be played to supplement and/orreplace elements in a replay of a segment. Another example ofsupplementary information which may be utilized is a director's runningcommentary or explanation of the scenes in a video which is included inalternate audio tracks in some DVDs. Accordingly, in those instancewhere the video includes a commentary, the activation of the What?function, or similar function, may be enabled that will play thecommentary track during the replaying of the scene. For example, duringthe playing of a DVD, a viewer may wish to have the director explain aparticular scene, in such case, the activation of the replay function,or, for example, a separate “Explain” function, by either pressing adedicated button or double pressing the What? button will cause theappropriate replay sequence to additionally or alternatively include thedirector's commentary. Under certain viewer preferences, both thesubtitle and commentaries are activated during the replay of asegment/scene.

Alternatively, or additionally, the authoring of a video may include, aseparate audio track having the express and dedicated purpose ofexplaining the various scenes of a video. This would be advantageous in,for example, technical or educational videos as well as in mysteries.The method of an “Explain” function and/or the embodiment of an Explainmethodology is similar to that detailed herein with respect to the What?function. However, note is made that, given the nature of a commentary,the amount replayed may be responsive to a greater degree to the segmentinformation provided by a video map than to some predefined amount.Thus, the replaying produced by a more encompassing What? function,e.g., “Explain”, is likely to, although not necessarily, be of a longerduration than that produced by a replay function that only requires thedisplay of subtitles.

The supplementary information may be provided by a source other than thesource of the video, and the supplementary information need not be timesynchronized with the video. For example, a supplementary informationprovided by a remote source may be utilized with a plurality ofdifferent video segments of a DVD video and/or a plurality of videos.

Still further, supplementary information may be displayed in a separatewindow within a display or output means, e.g., one of the speakers; orin a display or output means different from that playing the video,e.g., a separate monitor.

Still further, in an embodiment, the supplementary informationcompletely substitutes, with, for example, a different camera angle, orpresentation of the scene, the segment which would have been replayed.For example, in a video that teaches magic tricks, the What? functionmay be utilized to obtain different angles and/or explanations for themagic trick performed. The discussion herein with respect to the playingof camera angles suggest other embodiments.

Whether the playing of supplementary information is activated responsiveto a viewer's preferences 1243, system default settings 1244, or theauthoring of the video, the activation of the replay function will notcause the display of extraneous system messages such as “subtitle on”.

With the appropriate playing of the supplementary information enabled1243/1244, e.g., subtitles are turned on and the audio language istemporarily switched, the Multimedia Player's hardware, firmware, and/orsoftware processing means replay the video 1251 from the replayposition. If supplementary information was not played 1261, i.e., wasnot required 1241, than once the replay of the video commences 1251, theparticular instance of the replay routines are terminated.

At the supplementary information off position 1262, the MultimediaPlayer's processing routines terminate the playing of supplementaryinformation 1263, e.g., turn off the subtitle, and/or reverses any audiolanguages changes made. Clearly, the turning off of the supplementaryinformation does not occur if the particular configuration of thesupplementary information was turned on prior to the activation of thereplay function. Whatever supplementary information was being playedprior to the activation of the replay function would be continued afterthe supplementary information off position. In the absence of a playingof supplementary information during a replay, the activation of thereplay function would still provide other services consistent with theviewer's objects of replaying a segment of the video.

Thus, the functionality of a Multimedia Player, such as a DVD player, isenhanced, by providing a method, of replaying a segment of a video, forthe viewer who has not, for example, understood the dialogue. The methodbeing elegantly simple (e.g. single button action or voice command),responsive to viewer language preferences (e.g. preselected subtitlelanguage) and skip backward preferences and controls (e.g. predefinedamount of time and/or video map).

With respect to a playing of audio, conventionally, when a video ispaused, the last image of the video may be continued to be displayed onthe television but the audio is stopped. When video and audio aresynchronized, there are no provisions for the continuation of audiotransmission when the video segment is paused or frozen. Similarly, whenthe speed of the video is altered from its normal transmission speed, ifthe audio is continued to be transmitted, its transmission is alsoaltered or stopped. The alteration of the audio from a normal speed isseldom of value to the viewer.

In the transmission of variable content videos, whether primarilynon-interactive as for example a motion picture, or primarilyinteractive as for example an advertisement, whether retrieved from, forexample, a video server or from a DVD, the viewer is provided completecontrol over the transmission of the video. That control comprisespausing the video or altering the transmission speed. In such instances,operating routines provide for the continuation of the transmission ofan audio element at normal speed.

For purposes of the present disclosure, the audio component of a videois defined to consist of an active element and a passive element. Theactive or foreground element is that portion of an audio that is framesensitive, as for example speech or the sound emitted by an explosion.The passive or background element is that portion of an audio that isnot frame sensitive, as for example background music or traffic sounds.

The background element of an audio provides the audio than can becontinued over a certain period of time and still match the videocomponent. For example, where the video is of birds singing, the viewermay elect to freeze the image, the song of that particular bird and thebackground sounds are continued. When the video transmission isrestored, the video and audio components are re-synchronized andtransmitted in a conventional manner. Alternatively, the audio componenteventually catches up to the video at a normal transition point whereboth the video and audio components are re-synchronized and transmittedin a conventional manner.

In instances where the pause of the video is longer than the forwardaudio stream that applies to the paused video image, the audio retrievalloops back to the audio stream at the beginning or other point of thesegment in which the pause occurred, or to the point in which the pauseoccurred. In a preferred embodiment, the audio editing will provide forthe seamless looping of the audio. That is, at some point in theparticular audio segment, a seamless linkage is provided to a previouspoint in the audio segment. The linkage produces a continuous audioloop. To the listener, the audio, while repeating itself, will appear asa continuous stream.

It is noted that the teachings herein apply as well to slow motionvideo. In that case, the background audio stream is played at normalspeed, while the video stream is slowed down. The buffering and multipleread architecture detailed herein provide, for example, the requiredhardware capability.

Alternatively, or additionally, to the retrieval of the audio directlyassociated with the video, a separately stored plurality of audiosegments may be provided. These separate audio segments are specificallyintended to provide the audio required by a video segment when paused orthe transmission speed is altered.

An active audio element may be provided that is responsive to thespecific place where the video was paused. For example, during theviewing of an advertisement for an automobile, the viewer may pause thevideo when the dashboard instrumentation is shown. At that moment thepassive audio element (music) continues to be transmitted, the activeaudio element (general voice comments) is replaced by a frame specificactive audio element (instrumentation voice comments).

In instances where the transmission of the foreground audio element isdiscontinued, the volume of the background audio element may beaugmented to the level that had been provided by the foreground audioelement.

The audio requirements herein may be satisfied by a plurality ofarchitectures. The audio elements may be implemented as separatechannels, tracks, or audio streams. A video's audio is provided in amanner that permits extracting the various audio elements. The audioelements are further coded to permit satisfying the stereo or surroundsound requirements. Different elements from the various audio streams ortracks are combined in real-time to create the desired audio effects.What is suggested here, is that the audio elements that are present, forexample, in a performance of a fifty member orchestra, are individuallycontrollable and any of the elements may be combined interactively ornon-interactively.

A video map in combination with selectively retrievable musical elementsof the audio of a video permit playing the video as if it were a musicvideo. That is only the segments having a musical content, e.g. songs,are played and within those segments, the audio elements inconsistentwith this purpose, i.e., special effects sounds, are dropped. In otherwords, the video map provides the information required to extract fromwithin a motion picture a music video. The musical elements may beprovided by, for example, tracks, channels, or data that is separatefrom the data providing other of the audio elements.

The teachings disclosed herein with respect to the seamless transmissionof video are applied here to provide a seamless audio transmission ofnon-sequential audio elements.

Advantageously, the nonlinear editing system detailed herein, optionallyprovides, as per the teachings herein, the audio associated with thevideo being edited, while the video is being edited. In this fashion theeditor, has the benefit of the tempo of the background music or audiowhile editing a scene. This will provide for greater integration ofaudio and video material.

This method is particularly useful in the editing of a music video,where the edited audio stream is the constant to which the videosegments are applied.

FIG. 13 is an illustration of the utilization of foreground andbackground audio to provide audio during a video pause. The top half ofFIG. 13 is a representation of a full motion video stream 1371, and fouraudio streams 1372-1375 played without interruption. The bottom half ofFIG. 13 is a representation of the same full motion video stream andaudio stream played with a video pause.

In this example, the video is that of an automobile race. Four frames,representing segments 1361-1364 of video stream 1371 are shown. AUDIO11372 is sound from the voice of the commentators. AUDIO2 1373 transportsframe specific sounds or foreground audio. AUDIO3 1374 represents afirst background audio stream, in this case the sound from theautomobiles engines. AUDIO4 1375 represents a second background audiostream, in this case the sound from the audience.

In the second segment 1362 of the video stream 1371, the engine of oneof the automobiles explodes. This is illustrated in the representationsof both the AUDIO2 1373 and AUDIO4 1375 streams.

In the third segment 1363, the explosion becomes visually more evident.In the fourth segment 1364, the affected automobile is shown breakingapart.

In this example, the viewer elects during the transmission of the thirdsegment 1363 to pause or freeze 1381 the video stream 1371. During theduration of the pause 1381 of the video segment, audio is not providedby either the AUDIO1 1382 or the AUDIO2 1383 streams. During the pause,AUDIO1 and AUDIO2 are dropped off.

Audio during this pause 1381 is provided by the AUDIO3 1384 and AUDIO41385 streams of the fourth segment 1364. As is illustrated, thebackground audio segments 1384-1385 are looped to provide sufficientaudio during the video pause 1381. The volume of the background audio1384-1385, now in the foreground is automatically increased to anappropriate level.

Upon the viewer causing the video transmission to resume, the fourthsegment 1364 is transmitted together with the audio from there-synchronized audio streams 1372-1375.

It is noted that the SPEED keys provide control over the transmissionrates of, for example, the fast forward, rewind, frame advance, and playfunctions. Other keys may be used in combination, for example, while thevideo is being fast forwarded, the skip key may be utilized to furtheraccelerate the transmission rate.

At certain fast forward speeds, the video image displayed begins to losefunctionality. Accordingly, it is advantageous that a functional videoimage be transmitted at various play speeds. For example, as thetransmission speed increases, frames and/or parts of segments aredropped to still provide a visually understandable content, and asdetailed herein, real-time audio.

The frame and segment drop rates may be at a player's default rate, at aviewer specified rate, and/or some combination based on systemefficiencies. For example, in an Mpeg-2 compression stream,decompression may be facilitated by dropping B-frames and P-framesbefore dropping the I-frames. As the transmission rate (e.g. >13×)increases to approximate the I-frame rate, about one I-frame every ½second, (e.g. an average of 15×), the decompression of B and P framesmay be suspended, relying entirely on the available I-frames,irrespective of their actual frequency. In this fashion a viewerselection of, for example, 13×-17× may default to a 15× rate.

FIGS. 14A, 14B, and 14C, illustrate a plurality of fast-forward variableintermittent skipping methods that may be implemented. In the FIGS. thethick lines indicate the display of the frame or segment, horizontalthin lines illustrate the seamless skipping of a frame or segment, andvertical thin lines are utilized to show relative positions of playedsegments.

Specifically, in FIG. 14A, a portion of an MPEG2 video stream isillustrated showing a normal play rate and display of I, P, and B frames1411. As the fast forward rate is increased, the proportion of B framesdisplayed is decreased 1412. When a certain fast forward rate is caused,the display of B frames is eliminated entirely, and only I and P framesare displayed 1413. A further increase in the fast forward rate resultsin only I frames being displayed.

Alternatively, or additionally, to intermittently dropping frames, at,for example, a 10× search (forward and/or backwards) rate a viewer mayprefer instead to view a 6 second segment in real-time for every 60seconds of video, seamlessly skipping an average of 54 seconds. The sixseconds shown need not be taken from the same time interval of every 60seconds segment. Alternatively, or additionally, a video map mayidentify the most appropriate segments for the various search rates thatmay be selected. For example, a video map may identify the most relevantgroup of frames within a segment, and/or identify segments for a givensearch rate. Thus, based on a selected search rate, then the video mapprovides the information required to play the appropriate group offrames and/or segments.

FIG. 14B illustrates a video 1421 comprising a plurality of segmentsidentified by the single digit numerals. Segments 3 and 4, which may beparallel segments such as different camera angles, are shown interleavedas per the DVD specifications. Accordingly, in a playing of the video, asegment or segments that are excluded from the version being playedwould be skipped over 1422.

When the search rate reaches a certain speed, which, directly orindirectly, may be user specified, the playing of segments which wouldhave been played are selectively skipped in response to the video mapinformation 1423. As the search rate increases, more segments and/orfragments of a segment are seamlessly skipped 1424. These and othermethods that follow can be utilized to play condensed versions of avideo, which in the extreme may amount to playing segments comprising atheatrical trailer of the video. For example, setting a search forwardrate at ten times normal speed at the beginning of the video wouldresult in playing, in real-time, a 10 minute version of a 100 minutesmotion picture.

To provide intelligence to the dropping of segments, a video map could,for example, additionally provide information which may be utilized toassess the relative importance of segments, e.g., a segment may beassigned a relevance rating code ranging from 1-10, with 10 being themost relevant.

Alternatively, or additionally, as illustrated in FIG. 14C, a searchvariable intermittent skipping method may be based on the playing of afragment of a segment from a point identified by the video map as thebeginning of a segment and/or a chapter. The fragment of a segment thatis played resulting from, for example, the number of the identifiedsegments/chapters, the transmission rate, and the duration of the motionpicture. For example, if a normal rate playing of a version of a motionpicture 1422 would last 100 minutes, the video map identifies fiveplayable segments in the version, and the selected search rate is 5×,then up to the first four minutes of each segment would be played for atotal playing time of not greater than twenty minutes. FIG. 14Cillustrates a first instance 1433 in which, by this method, a portion ofthe 100 minute video 1421 is shown by playing, subject to the durationof each segment, the first four minutes of each of the five playablesegments. Alternatively, or additionally, a playing time for eachfragment of a segment may be specified.

Alternatively, or additionally, a viewer may achieve desired results byspecifying in addition to, or instead of the search rate, the percentageof the video and/or each segment, and/or the amount of time as a minimumor maximum given the length of the segment. For example, twenty percentof each segment but not more than two minutes nor less than 30 secondsfrom each segment. FIG. 14C illustrates a second instance 1434 in which,by this method, a proportional amount from each segment is playedsubject to the minimum and maximum specified amount for each segment. Aproportional amount played may also be subject to, e.g., factor in, therelevance rating code previously detailed.

Additionally, or alternatively, while with respect to motion pictures itmay not be as useful, in certain situations it may be advantageous,and/or preferred by the viewer to directly specify an amount to beapplied to each of the segments, and/or a specific amount for each orsome of the individual segments.

Additionally, given that the actual beginning of a chapter may be lesssignificant than other fragments of a segment, an offset from thebeginning may be implemented 1435, e.g., 10 seconds, two minutes, orsome proportional percentage and/or amount. Alternatively, the playedfragments may be with respect to a time prior to the end of a chapter1436. The end of the segment being identified directly or indirectly. Inthis instance, a proportional amount from each segment is played fromthe appropriate point calculated from the end of the segment, or fromthe beginning of the segment, if the duration of the segment is known.Additionally, or alternatively, the playing of a fragment of a segmentis with respect to some general internal point within segments and/or apoint specific to each segment 1437. A video map could provide thenecessary raw information and/or provide variable skipping specificinformation.

A number of other combinations are possible to satisfy particularapplications and preferences. For example, the skipping of segments, andthe playing of fragments may be implemented in combination with thedropping of frames to produce the most optimum visual display.

Where a segment or fragment viewed is sufficiently long, e.g. a 30second segment, full audio corresponding to the segment may be provided.Alternatively, whether the segment is of sufficient duration or not, themethods previously detailed with respect to FIG. 13 may be implemented.For example, in a twenty minute summary, only the lines deemed mostmemorable, and identified by the video map, need be played, the rest ofthe dialog would be skipped, playing only the musical soundtrack, soundeffects, and background audio.

A system, e.g., a Multimedia Player, capable of selectively playing afragment or fragments of each of a plurality of segments comprisespreferencing, processing, random accessing, and buffering for:seamlessly playing, responsive to a search rate preference and segmentinformation, a fragment of each of a plurality of segments of a video.In alternate embodiments, in a fragmented playing method, as the searchrate increases a smaller fragment of each of the plurality of segmentsis played; the segment information is utilized to assess the relativerelevance of segments, to enable for, example, as the search rateincreases, to skip playing fragments of segments with a low relativerelevance code; a length of a fragment played is responsive to a numberof segments, a search rate preference, and a length of the video thatwould otherwise be played; a length of a fragment played is proportionalto a length of a segment, and subject to a minimum and maximum specifiedlength; a length of a fragment played is responsive to specifiedfragment length preference; a fragment of each segment played is offsetfrom a beginning of a corresponding segment; a fragment of each segmentplayed is responsive to an end of a corresponding segment; a length of afragment played is responsive to the content of a corresponding segment;seamless playing, responsive to a search rate preference, is activatedduring a playing of the video; and/or the seamless playing, responsiveto a search rate preference, is utilized to search either backwardsand/or forwards through the video.

The understanding of visual perception to detail has resulted in greatcompression of images with a minimal loss in the perceived distortion ofan image or moving picture. Similarly, one could expect that the studyof the human capability to perceive different rates of visual and audiocontent can maximize effective transfer rates without loss in theacquisition of the information being transmitted. Just as individualscan read, with comprehension, at a faster rate than others, it ought tobe expected that some individual may prefer to view and/or listen tocertain video materials at a higher rate.

Further, not all content of a video need be viewed at the same “normal”or real time rate. That is, the viewing of a video could be according toa content responsive variable rate. For example, a viewer may preferthat segments coded as containing a graphic level of sexuality bedisplayed at slower than normal rate, segments of explicit violence andsegments that are fillers be displayed at a higher rate than normal, andthat segments with a graphic level of violence be seamlessly skipped asherein detailed. This would be particularly advantageous not only asecond viewing of a motion picture, but also in a review of aninstructional lesson, where the segments with material to which astudent responded with facilitate would be presented at a faster rateand in summary form, than the material with which initially the studenthad difficulty.

A Multimedia Player could, both through direct query and analysis of aviewer's viewing patterns and interactions, create an individualizedprofile in order to automatically customize the playing of a video in arange of visual and audio elements, including, for example, levels ofcontent in each of plurality of content categories, camera angles,zooming, perspectives, and transmission rates.

In instances where it may be preferred by a viewer or advantageous, tozoom in on an image, a video image transmitted to the video displaydevice is a portion of the available image. In other words, a zoomedimage or “window” transmitted to the display device is a subset of theavailable image (“image”).

Software controlled zooming functions may be implemented that zoomtowards the center of the image. In these instance the centers of thewindow and of the image are the same. The viewer could access thisfunction with, for example, the A-B buttons (242FIG. 2) of the gamingcontrols in the remote device (200 FIG. 2). Pressing the A-button wouldcause software to zoom in on the center of the image. With each pressingof the A-button a smaller portion of the image is enlarged to fill thedisplay. The B-button would have the opposite effect. Pressing theB-button would enlarge the field of view of the window. Eventuallyrestoring the window to the available image.

A viewer may, for example, utilize the control pad (251FIG. 2) of thegaming controls to place the zooming center point on any point on theimage. This will permit the off-center magnification of the image andthe creating of a window whose center is not the center of the image. Asthe video is transmitted the viewer could shift the center ofmagnification or track the target as it moves within the window and zoomin or out as desired.

What is detailed herein, however, is a method of automaticallymaintaining the viewer defined target within the viewer defined windowas the target moves within the image. Under control of an applicationsoftware the target is maintained within the magnification of the imagedefined by the viewer. As is detailed with respect to FIG. 15, once theviewer determines the target and desired zoom level, the windowcontinues to display the target as the target moves relative to the hostimage. In instances where the zooming center point is placed close tothe image's edge, the effective center point is automatically shifted toprovide a full window.

FIG. 15 comprises two sets of illustrations. The left side of FIG. 15represents the set of available images resulting from “frames” of avideo digitally stored video. The right side of FIG. 15 represents theset of images actually transmitted to the display device. Thisparticular example is that of an automobile race.

A “first” image 15 10 comprises five racing automobiles. This same image1510 is transmitted to the display device. Pressing of the X-button ofthe game controls enables the target selection functions, causing thedisplayed image 1520 to include a target pointer 1521. Utilizing thegame control pad, the viewer moves the targeting pointer 1521 to thedesired target. In this instance the selected target is the raceautomobile numbered five 1522. Pressing the X-button defines as thetarget the area or point identified by the pointer.

Depending of the configuration selected, a window frame 1523 istransmitted that is automatically sized to display the target at thecenter of the window frame.

In instances where the target is moving, it may be desirable that thewindow look ahead of the target. In such cases the target may beautomatically displayed off center in the window. Additionally, theviewer is provided the option to define the target's relationship to thecenter of the window. For example, in the viewing of a football game,the viewer may target a wide receiver, define a window of ten yards anda window center three yards ahead of the target. The window frame 1523may be moved by the viewer with respect to the target by means of thegame control pad, establishing a look ahead/behind reference withrespect to the target 1522. Additionally, the frame may be rotatedand/or inverted.

The viewer may utilize the A-button to zoom in on the defined target.The resulting window of the image defined by the window frame is thentransmitted to the display device. Pressing the A-button once more willfurther zoom in utilizing the target or the center of the window frameas the center of the magnification.

As is illustrated, the displayed window 1524 includes, at the option ofthe viewer, a smaller representation 1525 of the available image 1524.By utilizing the Y button of the game controls, the viewer is able tocommand the application software to switch back and forth between theimage 1525 and the window 1524.

A subsequent image 1516 depicts the race as it progresses. The targetrace automobile number five is shown passing race automobile numberedfour. As is illustrated, the application software has maintained thetargeted automobile centered in the displayed window 1526 while thetarget has shifted relative to the image. The application software hasalso maintained the magnification.

A later subsequent image 1517 depicts the further progress of the race.Again the software automatically maintains both the magnification andthe targeted race automobile in the displayed window 1527.

To convey the target's movement, the tracking of the target may be“imperfect”. The application software may pursue but not necessarilyalways display the target in the center of the image. For example, thechange in the velocity of the window relative to the change in thevelocity of the target includes a variable response algorithm.

The software program may depend on a variety of methods of identifying,recognizing, or separating the targeted object with respect to theavailable image. A first method relies on the producer of the video toidentify likely targets of magnification. In such a method, each of therace automobiles is pre-identified and the required data is included aspart of the video map or data associated with the video. Assisted bysoftware a video editor will essentially have to create the informationnecessary to be able to maintain the target within the viewer definedwindow. To target a race automobile, a viewer will enter thecorresponding identification number. Magnification suitable for eachtarget can also be preset by the video producer.

A second and preferred method utilizes the fact that objects in an imageare differentiated from each other by, for example, shape and/or colors.Thus, for example, upon the viewer placing a cursor on the numeral fiveof the target race automobile, the software creates an identificationfor the target that will permit the automatic recognition of the targetas the target moves about the image.

The identification or signature of the target may comprise mathematicalequations, spatial representations, color differentiations, pixelsignatures, and any combination of these and other image elements. Thisprocess is facilitated by the fact that the image is already digitallystored and that compression techniques such as fractal and waveletutilize mathematical techniques. Thus, if the image is being deliveredin wavelet compressed form it already includes the required differentspatial relationships.

The identification of the target need not be static. For example havingdistinguished the numeral five from the background and created one or aplurality of mathematical equations of the outline of the numeral five,the software is not only able to anticipate the likely location of theidentification in the image, but it is also able to recognize and/oranticipate different perspectives or distortions of the identificationas the host object moves.

There are instances where the identification of the object is absent inone or a plurality of frames. In the automobile race, this would occurwhen, for example, the target automobile is passing a competitor on the“outside”. Several methods are available to cause that the viewerdesired magnification and window are maintained. In a first method, thevideo map provides information to the application software when thecharacter of the image changes. If such information is not provided, thewindow is maintained. The application software projects the movement ofthe target in the image, and requires the target as the identificationis again recognized.

In a second method, the application software creates one or moresecondary identifications associated with the target. For example, alogo, bar-code, or other identification on the target automobile or anassociated object such as the helmet's signature of the driver of thetarget automobile. As the primary identification is lost, the softwareproceeds on the basis of the availability of the secondaryidentifications. When all are unavailable, the window is abandoned andthe full image is transmitted.

If the magnification request remains active, when the image provides therequired identification, the target is reacquired and the window isrestored.

It is noted that teachings herein are utilizable in a broad range ofapplications. For example, in the viewing of a football game the viewermay elect to isolate on any of the players, as well as other persons andobjects normally included in a wide angle image of a stadium. In asecond example, the target acquisition method may be utilized to enablea fire and forget missile to lock on a target and direct itself to thetarget. The image lock acts as an active homing system once effectivevideo acquisition is achieved.

FIG. 16 is a flow chart further detailing the steps of creating a windowresponsive to the viewer defined target and magnification. It is notedthat the zooming and targeting functions are continually available tothe viewer during the viewing of a video. This is represented by thelooping character of the flow chart. As previously indicated and as isshown in the flow chart the zooming and targeting functions whileintegrated may be enabled independently of each other.

Upon receipt of a target selection signal, for example, the pressing ofthe X-button of the game controls, target selection functions areenabled 1600. The target selection functions automatically pause thetransmission of the video 1601.

In instances where the targets in the image have been predefined 1602,the target selection functions display the target options 1603. Thedisplayed image provides a target pointer 1604. Utilizing the gamecontrol pad, the viewer moves the targeting pointer to the desiredtarget option. The application software processes the positioning data1605 and repositions the target pointer on the display 1606.

A second target selection signal indicates the selection 1607 of one ofthe predefined targets. Alternatively to the game control pad a viewermay select a target by means of, for example, the alphanumeric controlpad.

Alternatively, in instances where the target are not predefined, thetarget selection functions display a target pointer 1604 as before. Asthe user controls the target pointer, the application software processesthe positioning data 1605 and repositions the target pointer on thedisplay 1606. The second instance of a target selection signal indicatesthe selection 1607. In this case the selection is responsive to thepointer location.

Following the selection of a target, a target definition if available isobtained 1608, and a window is displayed 1609 that is automaticallysized to display the target at the center of the window.

Zooming functions are enabled 1610 upon the receipt of a zooming signal,for example, an A-button or B-button signal. Where the viewer isprovided the option to define the target's relationship to the center ofthe window 1611, a window frame is displayed 1612 and the viewer canrelocate the window frame with respect to the target by means of thegame control pad. The analysis of the frame repositioning data 1613causes the appropriate re-display of the frame 1614. Other options mayat this time be provided the viewer including for example targettracking options.

The processing of zoom data 1615 causes the automatic sizing of thewindow 1616 responsive to the increase in magnification or decrease inmagnification request. Zooming capabilities are enhanced by videocompression technologies that lend themselves to resolutionindependence, enabling high quality zooms to higher resolutions.

While the detailed disclosure with respect to FIGS. 15 and 16 are interms of a target of magnification, in an alternate embodiment a viewermay select within a single image a plurality of targets ofmagnification. The presentation of multiple zoomed tracked windows couldbe executed as a split screen of equally sized windows for each of theselected targets. Alternatively, as FIGS. 17F and 17G serve toillustrate, a viewer may designate primary target to occupy a largerwindow, and other of the zoomed images to occupy secondary smallerwindows.

With respect to the audio that is associated with the video, it isintended that the audio be responsive to the window generated or cameralangle selected. In the automobile race example, as the magnification isincreased the volume of the engines are increased. Clearly separateaudio tracks may be pre-associated with possible targets and the volumeof each tract may be spatially linked to the volume of the other tracks.The audio associated with a window results from the combination of thesounds of each of the elements of the image responsive to the spatiallinks. The volume of the audio being a factor of the apparent distanceto the camera eye. Thus if the image covers the entire race track, thesound of all the automobile engines are combined. However, the volume ofthe combination is responsive to the apparent distance to the camera.

Where the viewer targets a specific automobile and zooms in. The audiovolume of the target is increased. The audio volume of the other tracksare adjusted responsive to the spatial links as they relate to themagnification factor. For example, while the window would exclude anumber of other automobiles included in the image the correspondingaudio tracks are included, the volume of which is adjusted to reflecttheir relative distance to the target.

It is noted that the identification of a target may include the audiodata as well. Thus when the visual identification is lost, the audiodata confirms the presence or absence of the target and its relationshipto the window and the image.

When audio data is separately available for each of a plurality ofelements in a scene (e.g. different actors/actresses in a room), thespatial relationship between the audio elements is responsive to thecameral angle selected and the apparent position of the camera (e.g.viewed window) relative to the various elements in the scene. In otherwords, in a surround sound environment the viewer may perceive audioelements to originate from different locations within the sound field inresponse to the camera angle and zoom position selected. For example,when a camera is selected that places an actor in back of the camera(i.e. not viewable by the viewer), the voice of that actor would appearto originate from the rear of the sound field, e.g. the rear speakers ina multiple speaker system.

It is emphasized that an object is not to predetermine the allocation,position, and/or levels of audio elements, but to associate informationwith the various audio elements to enable the on-the-fly mixing of theaudio elements responsive to a particular viewer's interaction with thevideo elements of a video or content preferences.

Just as the teachings with respect to the video content of a variablecontent video redefine the relationship between an editor/producer'svideo editing and a viewer's content preferences, similarly theteachings herein intend to render the mixing of audio responsive to theviewer's content preferences.

The DVD specifications provides for the playing of one or more scenes orsections of a video from the perspective of a selected one of aplurality of camera angles. In the DVD specification, in order toseamlessly switch between camera angle presentations, the video of eachof the camera angle segments in a set of camera angle presentationsegments is separated into units and interleaved (“interleaved units”).FIG. 17A illustrates the interleaved units 1701.

Generally, in FIGS. 17A-17E, and 17H, a numeral identifies interleavedunits belonging to the same segment (e.g., a Cell); the capital lettersidentify a set of interleaved units sharing the same intended order ofplay; the thick lines represent the video played; and the thin linesrepresent a seamless skipping. The direction of progression being fromleft to right.

In those embodiments where a set of presentation segments are notinterleaved, the numerals are to be understood as identifying segmentssharing the same perspective, e.g., camera angle; and the capitalletters are to be understood as identifying a set of presentationsegments, i.e., a scene. In non-interleaved embodiments, the FIGS. showtwo sets of presentation segments, the term “interleaved” appearingherein should be ignored, and the disclosure is to be understoodaccordingly.

Herein a camera angle segment, segment perspective and/or segmentpresentation (“presentation segment”) consists of all of the contentcorresponding to one of a set of presentations of one scene of onesection. A “perspective”, “presentation”, and/or “presentationperspective” is, for example, content that is parallel to, and/orduplicative of, other content in a scene, content shot from one cameraangle, content from the viewpoint of one of the characters, and/or oneof a plurality of explanations of a lesson. A scene defines the durationof a presentation segment. A section of a video may include one or morescenes, and a chapter may include one or more sections. To the extentrequired, a set of presentation segments may or may not be interleaved.

Thus, a section could include a plurality of scenes each comprising aset of presentation segments. For example, a presentation of an inning(section) of a baseball game may include a scene (e.g., a set ofinterleaved presentation segments) including a presentation of: apitcher from the perspective of a first camera angle; a pitcher from theperspective of a second camera angle; a batter; a runner on first; thepitcher and the batter; and the pitcher, the batter, and the runner;wherein the scene is defined by, for example, as the complete at bat ofthe batter, or a single pitch. If the scene is defined by a complete atbat, than all of the batter's swings from a single perspective make up asingle presentation segment. Alternatively, if the scene is defined as asingle swing of the bat, than only one swing from a single perspectiveis included in any one presentation segment.

In the playing of a set of presentation segments (e.g., a Cell Block),the navigation software retrieves the Multimedia Player's camera angleor presentation setting and plays the presentation segment (e.g., Cell)matching the presentation preference. A presentation preference may beestablished prior to playing the video, at some time prior to theplaying of a scene, and/or during the playing of a scene.

FIG. 17A illustrates a seamless playing of segments from video stream1701 including an interleaved set of four presentation segments. In afirst example 1711, the playing of a video is responsive to onepresentation preference (1). In a second example 1712, the playing of avideo is responsive to a second presentation preference (3).

FIG. 17B shows two examples, where the playing of the video isresponsive to a previously established presentation preference (3), andis responsive to a presentation preference change (3 to 1) and (3 to 4)resulting from a viewer request, system request, video authoring requestduring the playing of an interleaved unit. In both examples, when thepresentation preference change request is initiated during the playingof an interleaved unit, the playing of the current interleaved unit isnot terminated. The change in the playing of interleaved units occurs atthe end of current interleaved unit, and proceeds with the beginning ofthe interleaved unit that follows in the next set of interleaved units.For example, when a presentation preference change occurs during theplaying of unit 3A, from presentation segment (3) to presentationsegment (1) 1721, the playing of the 3A unit is completed prior to theseamless playing of the 1B unit. Similarly, when a presentationpreference change occurs during the playing of unit 3A, frompresentation segment (3) to presentation segment (4) 1722, the playingof the 3A unit is completed prior to the seamless playing of the 4Bunit. A jump from 3A to 4A is not considered a seamless presentationchange.

The methods detailed with respect to FIGS. 17A and 17B are examples ofseamless playing of a set of camera angles. In a “non-seamless” anglechange, when a presentation preference change occurs, for example,during the playing of unit 3A, from presentation segment (3) topresentation segment (1), the playing of the 3A unit is interrupted andthe interleaved unit 1A, rather than 1B, is played from the beginning.

Accordingly, what is now described are methods of playing presentationsegments which are not provided by the above methods of playing a DVD.The unconventional methods that follow require a navigation softwareespecially adapted, by including routines written, to selectivelyutilize navigation data. Here, the navigation data, e.g., segmentinformation, may be provided by, or with, the source of the video and/orby an alternate source. FIG. 17C shows two examples that make greateruse of a buffering and random access capability to cause a faster changein the presentation segment displayed. In a first example, when apresentation preference change occurs during the playing of unit 3A,from presentation preference (3) to presentation preference (1) 1731,the playing of the 3A unit is interrupted immediately at that point thata seamless transition to the corresponding place in the interleaved unit1A of the newly selected presentation segment (1) can be affected by theparticular hardware implemented. This particular presentation changefrom (3) to (1) 1731 is distinguished from the second example, (3) to(4), 1732 of FIG. 17C, by the backward jump in the video stream.

The methodology detailed with respect to FIG. 17C is particularlyadvantageous in those instances where: i) the duration of theinterleaved unit is sufficiently long; ii) the required video ispreviously retrieved and/or already buffered; and/or iii) the videosource is a RAM, e.g., does not require a mechanical action.

FIG. 17D illustrates two methods, of playing a set of presentationsegments 1701, which are not possible with the use of, for example, anRCA RC5200P DVD player. These particular methods are advantageous inthose situations in which a viewer desires to view the entirety of ascene or section from two or more presentation perspectives withouthaving to manually rewind, and without requiring changing a preferencefor a specific presentation segment during the playing of the set ofpresentation segments.

In the first example 1741, the video stream is played as if it did notcomprise interleaved presentation segments. That is, the navigationsoftware does not execute the seamless jumps of interleaved units whichare conventionally executed in the response to a video map'spresentation data. In a DVD embodiment, the navigation software isespecially adapted to ignore, responsive to a viewer's contentpreferences, the data that causes the skipping of interleaved units.This method is particularly advantageous in those instances where theduration of the interleaved units are of sufficient time to provide auseful display, and/or where the viewer would prefer a playingcharacterized by frequent changes in the presentation perspective, as isthe case in many music videos. Although the technical seamlessness ofthe method of the first example 1741, does not require random access andbuffering beyond that which is available in current DVD players, theusefulness of the presentation may suffer from the high frequency ofpresentation changes.

In the second example 1742, responsive to, for example, a viewer'spresentation preferences all of the interleaved units of a presentationsegment from the set of interleaved presentation segments of a scene arefirst played before automatically playing any of the interleaved unitsof another presentation segment of the set. As is shown in the example,1742, the process repeating itself as all of the presentation segments,or the desired presentation segments, are substantially played.

By utilizing the navigation software to accomplish this automaticsequential playing of a plurality of presentation segments of a set ofpresentation segments, the viewer is provided with a complete,uninterrupted, operationally seamless, and elegant playing of eachpresentation segment of a set of presentation segments without requiringinteraction by the viewer.

Alternatively, a presentation preference may stipulate the playing ofeach of the presentation segments of each of the scenes in a section orplurality of sections that share the same perspective prior to playinganother presentation segment having a different presentationperspective. In other words, responsive to a presentation preference,scene and section definitions are ignored, within, for example, achapter. Such a playing could duplicate or skip, in a contemporaneoussubsequent playing, those segments (“common segments”) between sets ofpresentation segments.

The playing of multiple presentation segments may be responsive topreferences for a subset of the available presentation perspectives. Forexample, a viewer may not desire to view close ups. FIG. 17E shows twoexamples 1751 and 1752, corresponding to the two examples 1741 and 1742of FIG. 17D, in which the presentation segment (2) is seamlessly skippedin response to a preestablished content preference that directly orindirectly excludes the particular presentation segment.

Further, as is shown in the third example 1753 of FIG. 17E, the playingof multiple presentations may also be responsive to a preference for thesequence that certain presentation perspectives are played. For example,while one viewer may prefer a sequence of presentations comprising afaraway, midrange, and close-up sequence, a second viewer may prefer asequence of presentations comprising a faraway, close-up, and midrangesequence. The example 1753 of FIG. 17E, shows the playing of multiplepresentations in which the presentation (2) is excluded, and the orderof the presentations (1, 4, and 3) are played in a manner different fromtheir physical order (1, 2, 3, and 4), and the manner shown in thesecond example 1752 (1, 3, and 4).

As shown in the fourth example 1754 of FIG. 17E, the playing of aplurality of presentation segments of a set of presentation segments ofa scene and/or section may be set to loop any number of times orcontinually until the number of times established is played and/or theviewer causes an escape from the looping. In this example 1754, thelooping, is also randomized. (For clarity, illustrations of interleavedunits are duplicated.)

The activation of the playing of more than one presentation segment of aset of presentation segments, unless otherwise required or preferred,does not interrupt or discontinue a playing of a current presentationsegment.

The segment information in a video map and random accessing andbuffering capabilities are essential in the seamless playing ofpresentation segments, specially, for example, in a seamless playingcomprising a plurality of skipping forwards and backwards within a videostream as required, by for example, a continuous looping of a set ofinterleaved presentation segments. Methods detailed herein may requireeither a faster random access capability, a larger buffer, or somecombination of the two, than that required for the conventional playingof interleaved units to maintain a technical seamlessness.

A system, e.g. a Multimedia Player, capable of playing at least twopresentation segments of a set of presentation segments, e.g. a set ofcamera angle presentations, of at least one scene of a video, comprisesthe preferencing, processing, random accessing, and buffering means for:playing, responsive to a presentation preference and segmentinformation, at least one presentation segment of the set ofpresentation segments; skipping, responsive to the presentationpreference and segment information, to a beginning of a presentationsegment of the set of presentation segments; subsequently playing theskipped to presentation segment; and continuing, responsive to thepresentation preference, the skipping and the subsequent playing.

Alternatively to playing the entirety of a presentation segment beforeplaying a subsequent presentation segment of the same set ofpresentation segments, responsive to, for example, a viewer'spresentation preference for a fragmented playing, only a substantialportion fragment, or number of the interleaved units (“fragment”) of afirst-played presentation segment from the set of interleavedpresentation segments of a scene is first played, followed by playing afragment of a next-played presentation segment in the set, beforeproceeding with playing another fragment of the first-playedpresentation segment.

In a fragmented playing, the substantial fragment or number ofinterleaved units played is responsive to a preference for the maximumduration of a playing of a presentation perspective. For example, in asingle-pass playing (1742FIG. 17D) of a set of presentation segmentseach of two minutes duration, the first 1.5 minutes of playing would betaken up with the playing of the first 1.5 minutes of only onepresentation segment. By contrast in a fragmented playing, where thepresentation preference is established at 30 seconds, the first 1.5minutes would be taken with the playing of the first 30 seconds of eachof three of the four presentation segments.

A fragmented playing method can still be implemented in the absence of,or independently of, an interleaved set of presentation segments, eitherby utilizing direct information provided by a video map, or by, forexample, arbitrary fragmentation or calculation taking into account theparticulars of the specific set of presentation segments.

A system capable of a fragmented playing of at least two presentationsegments of a set of presentation segments of at least one scene of avideo, comprises preferencing, processing, random accessing, andbuffering for: sequentially and seamlessly playing, responsive to apresentation preference and segment information, and by means of arandom accessing and buffering, a fragment of each of at least twopresentation segments of the set of presentation segments; andcontinuing by sequentially and seamlessly playing, by means of therandom accessing and buffering, a subsequent fragment of each of the atleast two presentation segments until at least a last fragment of eachof the at least two presentation segments has been played. Thepresentation preference being with respect to a maximum duration of acontinuous playing of a presentation segment.

The playing of multiple presentation segments may be merged anddisplayed in a synchronized manner at the same time in equal sizewindows, or, as shown in FIGS. 17F and 17G, one presentation segment isshown full screen or nearly full screen (“primary window”) 1763, and theother presentation segment are shown in smaller “secondary windows” 17611762 1764, either superimposed on the larger window or in a space leftover by a near full screen primary window.

The particular configuration, placement, and relative sizes of theprimary window 1763 and secondary windows 1761 1762 1764 beingresponsive to system defaults, viewer's preferences, informationprovided by the video map, and/or the application of the viewer'spreferences to the information provided by the video map. A comparisonof the illustrations of FIGS. 17F and 17G suggests that a presentationdisplay preference change has been executed. In this example, thepresentation being displayed in the primary window 1763 of FIG. 17F isnow displayed in FIG. 17G in one of the secondary windows 1773.Conversely, the presentation being displayed in one of the secondarywindows 1764 of FIG. 17F is now displayed in FIG. 17G in the primarywindow 1774. Viewer routines for accomplishing the switching betweenpresentations is analogous to the switching of displays currentlyavailable in picture-in-picture (“PIP”) applications.

The selection of a particular presentation for display in the primarywindow need not be static or responsive to the execution of a specificpresentation display preference. The display of presentations in theprimary window can be automatically rotated responsive to systemparameters and/or viewer preferences. For example, in a looping of a setof presentation segments (1754 FIG. 17E), the synchronous simultaneousplaying of a plurality of presentation segments is rotated among primaryand secondary windows, with a “current” presentation segment occupyingthe primary window.

The techniques for, and methods of, merging multiple video streams beingknow in the art, as is evidenced by the PIP capabilities of variouselectronic devices. In the case where a set of presentation segments isprovided by a single stream, as in the case of a DVD, the interleavingof the presentation segments, and a sufficient combination of a highvideo retrieval rate and buffering, enable retrieving, buffering, andsynchronously simultaneously playing a plurality of presentationsegments within a single or a plurality of images, windows, and/ordisplays.

In order to provide a synchronized simultaneous display of the pluralityof the desired and physically separately provided set of presentationsegments, as illustrated in FIGS. 17F and 17G, each of the set ofinterleaved units is read, in advance of the time required for aseamless play, as is shown in the examples of FIG. 17H. In this method,the interleaved units are read into a buffer of a size sufficient toenable the processing of the video to play a synchronized simultaneousdisplay. The interleaving of segments, and minimizing the size of theinterleaved units reduces the buffering and random access requirements.As the size of the interleaved units approaches the method detailedpreviously with respect to FIG. 8B, and consistent with the minimalamount of data/frames required by the compression methodologiesimplemented, system requirements are reduced.

Nonetheless, as a result of the significantly larger amount of databeing processed, and the fact that the authoring of a video may not bedirectly supportive of this particular feature, the buffering requiredcan be expected, in certain embodiments, to be substantially larger thanthat found in the previously cited DVD player. However, certainconfigurations of a Multimedia Player detailed herein, already includesignificant memory assets that can be exploited for this particularpurpose, for the purpose of maintaining a seamlessness in thepresentation, and for any other specific and/or general purposesdetailed herein.

In FIG. 17H the presentation displayed in the primary window isillustrated with the thickest line 1781, the presentations displayed inthe secondary windows are illustrated with the medium thickness line1782, the video retrieval paths are illustrated with the thinnest lines1783, and a first set of interleaved presentation units or fragments areindicated by a bracket 1784.

The first example 1791 of FIG. 17H illustrates a case in which theplurality of presentation segments in a set are displayed, withpresentation segment (3) being displayed in the primary window. Thesecond example 1792 of FIG. 17H illustrates a case in which three of thefour presentation segments are displayed, i.e. presentation segment (2)is not displayed, and a change in the display of the presentationsegment (from 3 to 4) in the primary window has been executed. As in theexample detailed with respect to FIGS. 17F and 17G, the display ofpresentation segment (3) in the primary window has been replaced by thedisplay of presentation segment (4) during the synchronous simultaneousplaying of a plurality of presentation segments.

A system capable of simultaneously playing at least two presentationsegments of a set of presentation segments of at least one scene of avideo, comprises preferencing, processing, random accessing, andbuffering for: retrieving, responsive to a presentation preference andsegment information, and by means of a random accessing, a portion ofeach of at least two presentation segments of the set of presentationsegments; buffering the retrieved portion of each of the at least twopresentation segments; simultaneously playing in a synchronized manner,by means of the retrieving and the buffering, the portion of each of theat least two presentation segments; and continuing the retrieving,buffering, and simultaneously playing until at least a last portion ofeach of the at least two presentation segments has been played. Theplaying of the at least two presentation segments is rotated among aprimary and secondary windows. The displaying in a primary or asecondary window being responsive to a display preference.

It is emphasized that the methods herein shown are not confined tosituations in which the various presentation segments in a set are ofthe same duration and/or interleaved in the manner prescribed by the DVDspecifications. Further, methods herein shown are not confined to avideo stream retrieved from, for example, a DVD. As previouslysuggested, a DSS video stream, for example, comprising the transmissionof a set of presentation segments in faster than real time, utilizingmultiples of the data bandwidth required by a single stream, and/orutilizing a plurality of video streams, and whether buffered ordownloaded to a local storage, can also benefit from the methods hereindetailed.

Further, the techniques detailed herein with respect to fragmenting of asegment and the looping in the playing of a segment may be combined andutilized in a playing of a segment, scene, and/or sector which is not apresentation segment or part of a set of segments. For example, theplaying of a two minutes ice skating performance, could be fragmentedand looped to create a four minutes presentation, or an endlesspresentation of random seamless fragments of one or more segments. Thisparticular method may be advantageously be applied to scenes which are,for example, panoramic and/or visually interesting and where aredundancy of presentation would be enjoyable. A fragmented loopedplaying may also be advantageously utilized in those instances whererepetition is an important aspect of a learning experience, e.g.,learning videos for young children.

The fragmentation and looping of segments may be purely random,responsive to a video map defining fragments and/or segments and theirpotential order or combinations, and/or substantial changes in thecomparative content of frames, e.g., perspective change.

FIG. 17I illustrates an example of a fragmenting and looping of aplaying of at least one segment of a video. In a linear playing 1796 ofa video 1795 and in the absence of a viewer's interaction, e.g.,rewinding of the video, the content of a video segment is only displayedonce. In an example of a fragmented and looped playing of a segment1797, a segment is defined by a video map, indirectly by a reception ofa looping request, e.g., as in the activation of a replay function, ordirectly by a viewer identifying or marking (272FIG. 2) a beginningpoint and an end point. The illustration 1797 shows a defined segmentwhich has been arbitrarily fragmented, the firsts set of fragmentedsegments played, the segment is arbitrarily fragmented again, and as thesecond set of fragmented segments are played, the fragmentation of thesegment and playing of a fragment is repeated with the playing of asingle segment. In the illustration 1797, the looped playing of thefragmented segments is terminated in response to a termination command.The termination command may be issued by a viewer, be responsive to aviewer's preestablished presentation preference, e.g., amount of time orpercent duplication, be responsive to system settings, in response tosystem controls provided with the video, and/or responsive to aperception that a viewer has lost interest (e.g. repeated eye movementaway from the display). As in other methods herein, a fragmented loopedplaying method may also benefit from audio processing, e.g. droppingdialog.

A system capable of fragmenting and looping a playing of at least onesegment of a video, comprises preferencing, processing, randomaccessing, and buffering for: responsive to a viewer's request,arbitrarily dividing a segment or a segment definition corresponding toa segment of a video into a plurality of fragment definitionscorresponding to a plurality of fragments of the segment; utilizing thefragment definitions to play the plurality of fragments in a random,looped, and duplicative manner to produce a playing of the fragments ofthe segment that is of a longer duration than the playing of thesegment. Advantageously, the arbitrary dividing is responsive to apresentation preference for a minimum duration of a fragment, producesfragments of unequal length, and is repeated prior to a playing of eachset of fragments, and/or during a playing of set of fragments.Alternatively, or additionally, a random and repeated skipping withinthe boundaries of a segment is utilized to produce a fragmentized,randomized, looped playing of a segment.

In each method of playing a segment and/or presentation segment, whereappropriate or advantageous, the presentation preference may beactivated by a presentation command, e.g. a voice or remote controlcommand, received during a playing of a segment, established prior to afirst playing of a segment, for a sequence in the playing of segments,and/or, as detailed further below, responsive to a set of presentationperspective definitions established for a plurality of videos; theplaying, seamless or otherwise, of a segment, a plurality of segments,or all of the segments of a set, may be looped a preestablished numberof times and/or continuously until discontinued by a terminationcommand; and/or the playing of presentation segments seamlessly skippingany fragment of, or the entirety of, a presentation segment or segmentsinconsistent with content preferences including content, technical, andpresentation preferences.

The playing of presentation segments are further advanced by theimplementation in the definition of segments of a standardized set orsets of presentation perspective definitions that would facilitate theestablishing of presentation preferences applicable to a plurality ofvideos, and/or independently of any one video. For example, with respectto the utilization of cameras in the filming of a section of a dialogbetween two individuals, the standardized presentation definitionsinclude: Long Shot, Medium Shot, Close Up, High Angle, Low Angle,Overhead, and Over the Shoulder, each or in combination, and withrespect to, for example the principal actress or the actor in thesection. Other presentation definitions which may serve to define astandard comprise, for example: Angle Front (Full, ¾, ½, ¼), Angle Back(Full, ¾, ½, ¼), Angle Side (Full, ¾, ½, ¼), Angle Top (Full, ¾, ½, ¼)Angle Bottom (Full, ¾, ½, ¼) Perspective Female (None, Little, Mostly,Exclusive) Perspective Male (None, Little, Mostly, Exclusive). In thecase of sporting events, the presentation definitions may be establishedboth with respect to the areas of the field of play (e.g., in a baseballgame, right outfield), a player position (e.g. pitcher), and withrespect to the relative location of a primary or secondary object (e.g.the baseball and/or a base runner).

In general, content preferences, which include presentation preferences,may be established individually, in combinations, and/or as specified bylogical or Boolean operators (e.g. AND, OR, NOT, AND, NEAR).Specifically, standardized presentations definitions enable a viewer topreestablish presentation preferences that would serve to automaticallyexclude and/or include certain presentations or perspectives withrespect to, for example, an actor or actress, and with respect to thesubject matter or content of a section. For example, a viewer may preferto view, during romantic sections, a medium shot that includes theactress and actor, rather viewing a close-up of the actor. However, thesame viewer may not prefer that the same presentation preferences beapplied in violent sections or segments. Clearly, a viewer may preferthat a set of presentation preferences be applied in one context, andthat an opposite set of content preferences be applied in anothercontext.

An additional object and advantage of establishing a set of standardizedpresentation definitions is to enable a viewer to change presentationpreferences without requiring that the video presentation beinterrupted, and/or without requiring the utilization of a significantportion of the screen to identify or explain the presentationpreferences available. For example, given a standardized set ofpresentations each always associated with a 1-9 key in a remote control,the placing of a 3×3 matrix of numerals, 3-4 letter codes, or icons,highlighted for available presentation perspectives, provides a viewerthe information required for a purposeful presentation change.

Other simpler or more novel methods may be implemented, as, for example,may be suggested by the previous disclosure with respect to FIG. 15.Further, and in particular with respect to video of sporting events, forexample, a particular symbol (e.g. logo) or numeral in a uniform may becomputer highlighted to indicate the availability of a presentation.

As previously indicated, presentation preferences are a subset of a setof content preferences. It is intended that the methods herein detailedbe responsive to content preferences, including the relevant technicalpreferences and presentation preferences to, for example, directly orindirectly exclude a particular presentation segment and/or portion of apresentation segment. For example, while a particular presentationsegment may be consistent with a camera angle presentation preference, aportion of the presentation segment is seamlessly skipped because itprovides a level of graphic bloodshed that is inconsistent with acontent preference for implied rather than graphic bloodshed.

Further, some methods of playing presentation segments would be enhancedby incorporating the audio methodologies previously detailed withrespect to FIG. 13, particularly where the incidence of presentationchange is great and/or a looping is enabled. For example, the dialog maybe turned off during a playing of a second or subsequent presentationsegment following the playing of first or initial presentation segmentin the same set of presentations segments.

Still further, the playing of presentation segments is responsive to theactual availability of content as opposed to being responsive to, forexample, duplicated segment definitions, Duplicated segment definitionsmay be utilized to maintain a set number of presentation options acrossa plurality of sets of presentation segments, e.g. four camera angleoptions are provided in every set of presentation segments in a motionpicture. Unless otherwise required, software routines would, forexample, compare the segment definitions or utilize other video mapdata, to avoid playing content, interleaved units, portion of a segment,and/or segment definitions, that are duplicated.

Accordingly, the term “playing” as in playing a segment, and as inplaying a presentation segment, should be understood as meaning, as thecontext may require, “playing meaningfully, substantially, and/orresponsibly all or a portion” of a segment or presentation segment. Inother words, while a method may suggest or intend to play the entiretyof, or all, of a selected presentation segment, it does not follow,that, for example, every video, audio, subpicture segment portion,interleaved unit, frame, and/or bit of data will be played or need beplayed. As previously indicated, the subsequent playing of apresentation segment may omit playing the dialog while still playing thebackground audio.

While not shown, it should be appreciated that the methods detailed canbe equally applied to a “de-intertwining” of the playing of differentsections or scenes that are intertwined in a video stream to reflect, orsuggest, a time concurrence or a contemporaneous occurrence. Forexample, instead of playing sections in the intertwined manner that theyare physically stored, the Multimedia Player utilizes a video map toreorganize the order of the intertwined segments of each of the scenesso that one scene is first played in its entirety before a segment ofanother of the interleaved sections is played. Conversely, scenes whichare not physically intertwined may be played in an intertwined manner.In the extreme, a video map externally provided to a Multimedia Playercan permit the seamless automated playing of a video in, for example,manners not intended by the director of a motion picture.

An example of the application of the teachings herein, would be a novelplaying of the 1993 released motion picture “The Fugitive”, in which atthe beginning of the film, segments are played to indicate to the viewerthat the doctor was innocent of the crime for which he is pursued. Theplaying, as per the teachings herein, for a viewer who may prefer, forexample, to view the motion picture with a higher degree of intrigue,would play the particular segments at a later point in the playing ofthe motion picture.

It is intended herein that the methods of preestablishing orestablishing of content preferences include the preestablishing andestablishing of presentation perspective preferences. Additionally, thevarious viewer accessing means provide access to the specific functionsrelating to the preestablishing and/or establishing of presentationperspective preferences. For example, a voice command of, for example,“Angle Setup”, or pressing the “Angle” key on a remote control (200FIG.2) would cause, for example, a system audio/voice response and/or adisplay of the appropriate presentation perspective preferences options.

Alternatively, or additionally, command and keys may be configured totoggle between options or respond to, for example, a contemporaneoussubsequent request. For example, responsive to a viewer's preferences, asingle pressing of the Angle key would change the presentation segmentin a conventional fashion, while an initial and a contemporaneoussubsequent request, e.g. double pressing the Angle key, would enable thelooped random playing of presentation segments 1754 detailed withrespect to FIG. 17E. A subsequent pressing of the Angle key wouldterminate the looping and/or the playing of the presentation segments inthe set.

As it has been shown, while a particular specification or standard,e.g., the DVD specification, may call for certain functions, e.g., amethod of playing camera Angles, it does not mean that the creativeutilization of the data that may be obtained need be confined to what isrequired or suggested by a specification or standard that is advanced,published, and/or generally adopted, and embodied in the data. The pointonce more made, is that advantageous video services and features can beprovided by the innovative utilization of random access and supportiveautoactive software methods and principles.

As detailed with respect to FIG. 1, in a preferred embodiment aMultimedia Player is capable of simultaneously receiving and managing avariety of network transmissions. As indicated herein, and referring toFIG. 4, in a preferred embodiment the network provides video, data,voice/video communications and any variety of digital and/or analogtransmissions.

A variable content video provides for an elegant integration of thevideo and communication services that can be delivered to a viewer bythese and a variety of other communication systems. Specifically, whilea Multimedia Player is retrieving a video from either a video servicesprovider or from a storage device, a Multimedia Player may receive acommunication. The “communication” may be in the form of a phone call,videophone call, fax, massaging and paging, and any analog or digitaltransmission.

A video and communication system for integrating the retrieval of avideo and a communication comprises for example: i) retrieving means forretrieving a video from a video provider or from a storage means storingsaid video; ii) communicating means for receiving a communication; iii)accepting means for accepting said communication; iv) terminating meansfor terminating said communication; v) pausing means, responsive to saidaccepting means, for automatically pausing said retrieving; vi) resumingmeans, responsive to said terminating means, for resuming saidretrieving; vii) transmitting means, responsive to said retrievingmeans, for transmitting to a viewing system; and viii) preferencingmeans for establishing video content preferences.

In those instances that the video comprises a video map defining aplurality of video segments of the video, the retrieving means,responsive to an application of the video content preferences to thevideo map, not only retrieves a version of the video, but alsoidentifies an appropriate prior point to resume retrieving videosegments following a pause in the retrieving.

Referring to FIG. 18, a viewer of the video being transmitted to thedisplay is likely to have identified himself or herself to a MultimediaPlayer as was previously detailed with respect to FIG. 9A. Similarly,the user of a computer-type application may have logged in, and therebyalso provided a Multimedia Player with his/her identity. Thus, during aMultimedia Player's transmission 1801 of a video to a display, when aMultimedia Player receives a communication 1802 and if the communicationidentifies the specific intended recipient 1803, a Multimedia Player'ssoftware routines are able to automatically direct the communication toan appropriate device. A Multimedia Player, in this case, automaticallyroutes the communication 1804 to the display, the terminal, and/or theremote control.

Alternatively, depending on the nature of the communication, aMultimedia Player may provide the originator of the communication themeans to direct the routing of the communication. For example, in avoice call, voice response software will provide the caller anappropriate voiced menu to provide the routing information. Other meansactive or passive may be available for a Multimedia Player to determinethe proper routing 1805. For example matching “Caller ID” with a tablematching callers with recipients.

If proper routing of the communication cannot be determined by aMultimedia Player, the communication is directed to a default deviceconsistent with the character of the communication 1806. For example, inthe case of a fax to fax machine or a Multimedia Player's fax software.

In this example, the communications is a videophone call and is directedto the display at the time that a Multimedia Player is transmitting avideo to the display 1801.

Directing the communications to the display first causes a MultimediaPlayer to provide an appropriate video and/or audio signal 1810 to theviewer through the display. The signal may include caller identificationand other data relevant to or associated with the call.

If the viewer accepts the call 1811, the Multimedia Player initiatesroutines 1821-1823 to cause that the transmission of the video to thedisplay is paused 1824. Viewer acceptance of the communication mayinclude, for example, picking up a receiver, pressing a key on a remotecontrol device, a voice command, or directly touching an icon on ascreen either in a remote control device or on the display itself. Thus,a single viewer action or command 1811 both accepts the call and pausesthe video 1824.

If the viewer does not accept the call during a predefined time, theMultimedia Player terminates the audio/video signal and engagescommunications recording function or devises to receive a message 1813.At the end of the message, the Multimedia Player hang-up on thecommunication. In this case the video transmission to the display is notpaused and Multimedia Player video transmission continues uninterrupted.

Where the video is being retrieved from a video services provider videoserver 1821, the Multimedia Player transmits to the video server theappropriate pause commands 1822, causing the video server to hold thefurther transmission of the video 1824. When the video is beingretrieved from the Multimedia Player's own video storage module, (e.g. aDVD) the Multimedia Player pauses the retrieval 1823 of the video fromthe storage module, also pausing the video transmission 1824.

A Multimedia Player's automatic integration of the delivery of a videoand the acceptance of a communications may be configured by the viewerin any of a plurality of modes. The viewer may configure the MultimediaPlayer to cause a display of information relating to the incomingcommunication (data and image) on a window, without necessarily pausingthe transmission of the video but lowering the audio associated with thevideo if the communication comprises a sound element.

The flow chart of FIG. 18 presumes that the viewer has configured thesystem to pause the video when a communication is accepted. In thiscase, the video's image may be replaced with a blank screen, neutralimage, or informational data. When the communication is a video call,the screen image is replaced with that of the incoming call 1831.

When contact management software is available, and if the communicationis deemed to require the use of such software 1841, the viewer isprovided the opportunity to make such notations with respect to thecommunication 1842 as the viewer may require. Alternatively, the viewermay cause the Multimedia Player to log the communication. The screendisplay is intended to accommodate both a communications window and acontact management window.

When a pause in the transmission of the video, whether resulting fromthe acceptance of a communications or a viewer's pause command, exceedsa certain time limit 1851, the Multimedia Player will automaticallydisconnect the linkage to the video server or put the disc module tosleep 1852. In such instances the Multimedia Player and/or the videoserver retains the required information to initiate transmission of thevideo at the appropriate point.

Upon completion of the communication 1858-1859 or when the play commandis issued by the viewer, if disconnection occurred or the disc modulewas put to sleep 1852, the Multimedia Player will reestablish thelinkage with the video server or awaken the disc module 1853.

Upon completion of the communication 1858-1859, the delivery of thevideo is automatically restarted at the point placed on hold 1869, atsome predefined amount of time prior to the placing on hold of thevideo, or at a suitable prior point in the video.

When the video being delivered comprises a video map 1861, the mapidentifies the beginning point of the segment in which the pauseoccurred thus automatically identifying a suitable prior point 1862 inthe video to restart the delivery of the video 1863. By automaticallyreplaying at least the portion of the segment prior to the paused point1863, and then continuing the play of the video from the paused point1869, the viewer re-engages the video at the paused point 1869 without aloss of continuity.

Alternatively, or additionally, in the absence of a video map 1861, theamount of video replayed 1863 may be in some direct proportion to theduration of the pause 1864. That is, if the pause was only a few secondsin duration, only few seconds worth of frames or a single segment may bereplayed 1865. However, if the pause was for a considerable longerperiod of time 1864, a greater number of frames or segments may bereplayed 1865.

In instances where proportionate replay 1864 is combined with theavailability of a video map, the map provides the necessary informationto identify an appropriate prior point from which point the video isreplayed 1865. The video is then continued from the paused point 1869.

If a video map is not available 1861, and proportionate replay is notelected 1864, or the viewer has elected that following the pause thevideo continue directly from the paused point, then the video iscontinued from the paused point 1869.

Thus a single viewer command, whether play or the termination of thecommunication, automatically “rewinds” the video to an appropriate pointprior to the pause, and plays the video from that point.

A significant contribution intended by the present disclosure is tofurther advance the benefits to be provided to consumers by thesynergistic inclusion of a video map with the visual and audiocomponents of a video, and to further advance the potential of avariable content video.

The teachings disclosed herein, directly and indirectly by, for example,incorporation, are intended to show a variety of architectures,services, capabilities, systems, methods, and inventive elements whichare combined and may be combined to suit particular embodiments. Thesynergies among and between the various inventive elements is asignificant feature of the disclosures herein. The various examplesincluded herein demonstrate that it is intended, and deemedadvantageous, that each of the methods detailed herein benefit from theteachings presented with other methods detailed herein.

Further, it is the intent of incorporation to derive the full benefits,as an addition or an alternative, of the logical integration of theteachings herein with the teachings of the references cited. Theincorporation by reference at a specific place within the specificationis not intended to limit the extent to which the reference isincorporated, or the manner in which it may be integrated.

Where a teaching may be deemed to be at cross purposes, or otherwiseincompatible, with some other teaching, it ought to be understood as apossible alternative to be utilized as a particular preferred embodimentmay require. Clearly, it may be neither advantageous nor practical forall the elements or a particular combination of elements to beimplemented in a single embodiment.

While elements of the inventions have been detailed in conjunction withspecific embodiments thereof, it is evident that many alternatives,modifications and variations are possible and will be apparent to thoseskilled in the art in light of the foregoing description. Accordingly,it is intended to embrace all such alternatives, modifications,variations, and combinations as fall within the spirit and broad scopeof the specification.

While the title, abstract, and claims initially presented are drawn toparticular inventive elements, it is intended that other inventiveelements disclosed herein will be the subject of their own correspondingclaims.

The teachings that has been cited and incorporated herein are offered byway of example, and not limitation, of the underlying foundation ofknowledge and skill that is available to a practitioner. Since the artis well established, many of the features, components, and methods foundtherein may be incorporated, as suggested herein, in a preferredembodiment; and since other modifications and changes varied to fitparticular requirements and environments will be apparent to thoseskilled in the art, the inventions are not limited to the embodimentsset forth or suggested herein. It is to be understood that theinventions are not limited thereby. It is also to be understood that thespecific details shown are merely illustrative, and that the inventionsmay be carried out in other ways without departing from the broad spiritand scope of the specification.

What is claimed is:
 1. A method of playing a set of interleavedpresentation segments arranged, responsive to a single reading unit anda buffering architecture, within a previously edited video program, themethod comprising the steps of: consecutively playing, following asingle presentation preference change, at least a portion of each of atleast two presentation segments from said set of interleavedpresentation segments included within said video program, said playingnot requiring an alternative program source.
 2. The method of claim 1,wherein a playing of at least one portion of a presentation segment isskipped in response to a content preference established prior to playingsaid video program.
 3. The method of claim 1, wherein said set ofinterleaved presentation segments are a set of interleaved camera anglesegments; wherein said consecutively playing comprises a playing ofalternating portions of at least two camera angle segments; wherein saidalternating portions are responsive to a preference, established priorto playing said video program, for a duration of a portion of apresentation segment; and wherein a playing of at least one portion of acamera angle segment is skipped in response to a content preferenceestablished prior to playing said video program.
 4. A method of playinga set of interleaved presentation segments arranged, responsive to asingle reading unit and a buffering architecture, within a previouslyedited video program, the method comprising the steps of: consecutivelyplaying, following a single presentation preference change, alternatingportions of each of at least two presentation segments from said set ofinterleaved presentation segments included within said video program,each of said portions being responsive to a preference, establishedprior to playing said video program, for a duration of a portion of apresentation segment, said playing not requiring an alternative programsource.
 5. The method of claim 4, wherein said consecutively playingcomprises a looped playing of at least a portion of one of said at leasttwo presentation segments from said set of interleaved presentationsegments.
 6. The method of claim 4, wherein a playing of at least oneportion of a presentation segment is skipped in response to a contentpreference established prior to playing said video program.
 7. Themethod of claim 4, wherein said set of interleaved presentation segmentscomprises different explanations of a lesson.
 8. A method of playing aset of interleaved presentation segments arranged, responsive to asingle reading unit and a buffering architecture, within a previouslyedited video program, the method comprising the steps of: playing,responsive to a presentation preference established prior to playing anyportion of any presentation segment from said set of interleavedpresentation segments, at least a portion of a presentation segment fromsaid set of interleaved presentation segments; receiving, during saidplaying of said at least a portion of a presentation segment, a singlepresentation preference change; and consecutively playing, followingsaid single presentation preference change, at least a portion of eachof at least two presentation segments from said set of interleavedpresentation segments included within said video program, said playingnot requiring an alternative program source.
 9. The method of claim 8,wherein said consecutively playing comprises a looped playing of atleast a portion of one of said at least two presentation segments fromsaid set of interleaved presentation segments.
 10. The method of claim8, wherein a playing of at least one portion of a presentation segmentfrom said set of interleaved presentation segments is skipped inresponse to a content preference established prior to playing said videoprogram.
 11. The method of claim 8, wherein said set of interleavedpresentation segments are a set of interleaved camera angle segments;wherein said consecutively playing comprises a looped playing of atleast a portion of one camera angle segment from said set of interleavedcamera angle segments; and wherein a playing of at least one portion ofa camera angle segment is skipped in response to a content preferenceestablished prior to playing said video program.
 12. A method of playinga set of interleaved presentation segments arranged, responsive to asingle reading unit and a buffering architecture, within a previouslyedited video program, the method comprising the steps of: consecutivelyplaying, without requiring a presentation preference change during aplaying of any portion of any presentation segment from said set ofinterleaved presentation segments, the entirety of at least twopresentation segments from said set of interleaved presentation segmentsincluded within said video program, said playing not requiring analternative program source.
 13. The method of claim 12, wherein said setof interleaved presentation segments comprises different explanations ofa lesson.
 14. The method of claim 12, wherein said consecutively playingcomprises a randomized looped playing of portions of each of said atleast two presentation segments.
 15. The method of claim 12, whereinsaid consecutively playing of the entirety of at least two presentationsegments comprises a playing of alternating portions of said at leasttwo presentation segments; and wherein said alternating portions areresponsive to a preference, established prior to playing said videoprogram, for a duration of a portion of a presentation segment.
 16. Themethod of claim 12, wherein a playing of at least one portion of apresentation segment from said set of interleaved presentation segmentsis skipped in response to a content preference established prior toplaying said video program.
 17. The method of claim 12, wherein said setof interleaved presentation segments are a set of interleaved cameraangle segments; wherein said consecutively playing comprises arandomized looped playing of at least a portion of a camera anglesegment from said set of interleaved camera angle segments; wherein aportion of a camera angle segment played is responsive to a preference,established prior to playing said video program, for a duration of aportion of a presentation segment.
 18. A system capable of playing a setof interleaved presentation segments arranged, responsive to a singlereading unit and a buffering architecture, within a previously editedvideo program, the system comprising preferencing, processing, randomaccessing, and buffering means for consecutively and seamlessly playing,following a single presentation preference change, at least a portion ofeach of at least two presentation segments from said set of interleavedpresentation segments included within said video program, said playingnot requiring an alternative program source.
 19. The system of claim 18,wherein said consecutively and seamlessly playing comprises a loopedplaying of at least a portion of each of said at least two presentationsegments.
 20. The system of claim 18, wherein a playing of at least oneportion of a presentation segment is skipped in response to a contentpreference established prior to playing said video program.
 21. Thesystem of claim 18, wherein said set of interleaved presentationsegments are a set of interleaved camera angle segments; wherein saidconsecutively and seamlessly playing comprises a looped playing of atleast a portion of a camera angle segment from said set of interleavedcamera angle segments; and wherein a playing of at least one portion ofa camera angle segment is skipped in response to a content preferenceestablished prior to playing said video program.
 22. A system capable ofplaying a set of interleaved presentation segments arranged, responsiveto a single reading unit and a buffering architecture, within apreviously edited video program, the system comprising preferencing,processing, random accessing, and buffering means for playing,responsive to a presentation preference established prior to playing anyportion of any presentation segment from said set of interleavedpresentation segments, at least a portion of a presentation segment fromsaid set of interleaved presentation segments; receiving, during saidplaying of said at least a portion of a presentation segment, a singlepresentation preference change; and seamlessly and consecutivelyplaying, following said single presentation preference change, at leasta portion of each of at least two presentation segments from said set ofinterleaved presentation segments included within said video program,said playing not requiring an alternative program source.
 23. The systemof claim 22, wherein said consecutively and seamlessly playing comprisesa playing of a portion of each of said at least two presentationsegments followed by a playing of another portion of each of said atleast two presentation segments.
 24. The system of claim 22, wherein aportion of a presentation segment played is responsive to a preference,established prior to playing said video program, for a duration of aportion of a presentation segment.
 25. The system of claim 22, whereinsaid consecutively and seamlessly playing comprises a randomized loopedplaying of portions of each of said at least two presentation segments.26. The system of claim 22, wherein a playing of at least one portion ofa presentation segment is skipped in response to a content preferenceestablished prior to playing said video program.
 27. The system of claim22, wherein said set of interleaved presentation segments are a set ofinterleaved camera angle segments; wherein said consecutively andseamlessly playing comprises a randomized looped playing of portions ofeach of at least two camera angle segments from said set of interleavedcamera angle segments; and wherein a portion of a camera angle segmentplayed is responsive to a preference, established prior to playing saidvideo program, for a duration of a portion of a presentation segment.